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ABSTRACT 

Reported are four studies resulting from achievement 
testing activities from 1971 to 1973 vith approximately 17,000 
hearing impaired students from under 6 to over 21 years of age. The 
first study reports the relationships between selected achievement 
test scores (Paragraph Meaning and Arithmetic Computation subtests) 
and the following variables: sex, proportion of the school day spent 
in special educational classes, type of program, age at which formal 
education was begun, age at onset of the hearing loss, hearing status 
of parents, degree of hearing Iogs, nonverbal IQ test scor^, and 
presence or absence of additional handicapping conditions. The second 
study reports on the extent of guessing or "chance" level scores in 
the achievement tests of hearing impaired students and reviews the 
literature related to the question of guessing and correction for 
guessing in objective psychometric tests. The third study reports the 
intercorrelations among the various subtests within each of the five 
batteries of the Stanford Achievement Test. The intercorrelations for 
hearing impaired students are compared to the data for hearing 
students and are examined according to the age of the hearing 
impaired students. The fourth study reports the results of a mail 
survey of special educational programs for hearing impaired students 
regarding the extent of usage of various achievement tests. The 
implications of these results for future testing activities are 
considered. Also included are descriptions of the data collection 
methods, the qualifications and limitations of the data, and the 
demographic characteristics of the students in the 1971 testing 
program. (Author/DB) 
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ABSTRACT 



This publication includes four studies resulting from the ;tchicvenienl testing ;iciivilies of the 
Annual Suivey of Hearing Impaired Children iind Youih. The Hrst three studies are based on data 
obtained in the 1^71 National Achievement Testing Program: the fourth is a rcp4Ui of a survey con- 
ducted during the W72-73 school year. 

The fust study reports the relationships between selected achievement test scores i Paragraph 
Meaning and Arithmetic Computation Sub-tests) of 8. II. 14, and 17 year old hearing impaired stu- 
dents at^d the following vaiiables: sex. proportion of ihe school day spent in special cducalional 
classes, l^pe of program, age at which formal education was begun, age at onset of the hearing 
loss, heiuing status of parents* degree of hearing loss, non-verbal 1,Q. test score, and presence/ab- 
sence of additional handicapping conditions. These relationships are considered only as functional 
associations, without causal implications. 

The second study reports on the extent of guessing or '^chance" level scores in the achievement 
tests of hearing impaired students and review s the literature related to the question of guessing and 
correction for guessing in objective psychometric tests. 

Ihe third study lepi^rts Ihe intercorrelations among the various sub-tests wjihin each of the 
five baiieiies of the Sti^nford Achievement Test. The intercorrelations for hearing impaired students 
are compared lo the data for hearing students and are examined according to the age of the hearing 
impaired students. 

T he fourth stud;^ repoits the results of a mail surve> of special educational programs for hearing 
impaired students regarding the extent of usage of various achievement tests. The implications of 
these results for future testing activities of the Annual Survey are considered. 

Descriptions of the data collection methods, of the qualifications and limitations of the data, 
and of the demographic characieristics of the students in the 1971 testing program arc included in 
the lepoi t. 

The Annual Survey of Hearing Impaired Chi^ren and Youth is conducted by the Office of 
Demographic Studies at Gallaudel College. The major source of support is grant funds from the 
National Institute of Education. lX*partmeni of Hcalih, Hducation and Welfare. The addiiional fund- 
ing is provided by Galfaudet College. 
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INTRODUCTION 

This publication is the fourth to appear with anal- 
yses of data resulting from the 1971 National 
Achievement Testing Program conducted by the 
Annual Survey of Hearing Impaired Children and 
Youth. It represents part of the continui;ig effort of 
the Annual Survey to provide national data on the 
academic achievement of hearing impaired students 
and to determine the appropriateness and suitability 
of standard achievement tests for this studrnt popula- 
tion. 

Since its inception* the Annual Survey has 
devoted part of its resources to colJecting and analyz- 
ing achievement test information on students attend- 
ing special educational programs for the hearing 
impaired; this Survey effort was in response to the 
widely expressed need for information of this nature. 
The longer r-^nge purposes of this activity arc to 
determine the suitability of existing achievement tests 
for these students and to develop procedures and 
materials designed to enhance the usefulness and 
accuracy of achievement testing results. 

This publication presents (he results of four 
studies. Three of these studies were undertaken with 
data collected on a national group of hearing impaired 
students who were administered the Stanford 
Achievement Test in the spring of I97K The fourth 
is the report of a survey taken during the 1972-73 
school year of the usage of standardized achievement 
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tests in educational programs for hearing impaired 
students. An examination of the characteristics of 
nearly 17,000 of the hearing impaired students who 
participated in the testing program is presented in 
Appendix 1. These characteristitcs arc compared with 
those of the 41,109 hearing impaired students for 
whom data were reported to the Annual Survey dur- 
ing the 1970-71 school year. 

The first study is concerned with the relationship 
between achievement test scores and a series of vari- 
ables other than those for which data have been pre- 
sented in previous publications from the Annual Sur- 
vey. The following variables are examined: sex, pro- 
portion of the school day spent in special educational 
classes, type of special educational program, age at 
which formal education was begun, age at onset of 
the hearing loss, hearing status of parents, degree of 
hearing loss, non-verbal I.Q. scores, and presence or 
absence of additional handicapping conditions. The 
relationships are displayed as a simple function of 
dichotomizing each of the variables and catculaling a 
mean and standard deviation for each resulting group 
of students in the 8, 1 1, 14, and 17 year old age cate- 
gories. The relationships are described purely as func- 
tional associations, without any implications of caus- 
ality, for the purpose of suggesting potentially 
fruitful areas for future research consideration. The 
demographic variables are considered in relation to 
scores on Paragraph Meaning and Arithmetic Compu- 
tation, two sub-tests which are, respectively, among 
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the lowest iind the highest scores obJaineU by hearing 
impaired students. The difTerential degrees of related- 
ness of the nine variables to these two subtest scores 
are also examined. 

The Necond Nlud> lektle.s to the often raised 
question of (he influence and e\(eni of guessing on 
achievement (and other) lests written in multiple- 
choice formal. The hteramre in this regard Is 
reviev^ed brrefly, and d^^a obtained from samples of 
students tested in the 1971 testing program arc pre- 
senledv The results indicate thai guessing was a rela- 
lively minor problem on the majorily of sub-tests 
studied in terms of the exieni of its occurrence. The 
results also suggest that in the great m.yoriiy of cases, 
scores which do occur at or befow the "chance" level 
are due to guessing rather than to lack of time to com- 
plete the lest or to other factors. 

The third study examines the intercorrelations 
among the sub-tests of the five batteries of the Stan- 
ford tests for hearing impaired students. These inter- 
correlations arc compared, first, to similar figures for 
the hearing standardization sample upon which ihe 
norms of the Stanford are based. Next, the iniercor- 
relations are examined with reference to the age of 
the examinees. The first comparison indicates gener- 
ally lower intercorrelalions for the hearing impaired 
group than for the standardi^alion sample. The sec- 
ond comparison, by age, generally shows decreasing 
correlations as age increases for hearing impaired stu- 
dents, a situation which is the reverse of the general 
trend among students in the standardization sample, 
Jn all cases* however, the differences are not great, 
and the Stanford tests are seen to exhibit psychomei- 
ric properties when used with hearing impaired stu- 
dents which are very similar to those exhibited wilh 
the national sample of hearing students. 

The final study* the only one in this publication 
not based on data from the 1971 testing program, 
reports the results of a mail survey conducted during 
the 1972-73 school year regarding the usage of 
achievement rests in educational programs for hearing 
impaired students. A total of over 850 programs were 
asked whether they plan to use a standardized 



achievement test during the 1972-73 and 1973-74 
school years, which icst(s) they plan to use if any, 
and the number of students to be tested. A large 
majority of the responding programs who plan to use 
some achievement test(s) reported that they plan lo 
use the Stanford Achievement Test, either alone or 
in combination with some other te&t(s), Among pro- 
grams planning to use only a single test, the Stanford 
will reportedly be used with more than 15 times as 
many students as the next most frequently used test. 
The implications of these findings for the future 
achievement testing activities of \ht Annual Survey 
are discussed. 

Three publications on the results of the 1971 
National Achievement Testing Program conducted 
by the Annual Survey of Hearing Impaired Children 
and Youth have already appeared. In the first two 
of these,' the background of this testing program and 
the many qualifications relating to use of its results 
appeared at the beginning of the publication. On the 
assumption that those interested in the results of this 
testing program had already twice read ihis material, 
it was printed as an appendix to ihe third such pub- 
lication,' This material appears again as Appendix II 
to this publication. Anyone not familiar with this 
material, especially the qualifications of the data upon 
which these studies are based, should read this 
appendix. Appendix Ml will provide background 
information on the standardized testing procedures 
developed for the 1971 Achievement Testing Pro- 
gram. 



^h^m Anahsis of an Achievemrn/ Testirtf} Program for 
Hearhifi impaired Studenis, Vnifed Stalea: Spring 19?/. 
Gallaudet College, Office of Demographic Studies, Series 
D. Numbers. 

Academic Achievement Tesi Results of a Notional Test- 
my Projinmfor Hearin}^ in^poired Students. iJmted States: 
Spr'mg 197). Gallaudet College, Office of Demographic 
Studies, Series D. Number 9, 

*Sturf/es in Achiewemeni Testing, Hearing (repaired 5rw- 
dents, United Smes: Sprinfi !97t. Gallaudet College, Office 
of Demographic Studies. Series D. Number 11, 
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Associations Between Achievement Test Performance 
and Selected Ciiaracteristics of Hearing Impaired 
Students in Special Educational Programs: 
United States, Spring 1971 

Peter Ries 



INTRODUCTION 

Three previous pubUcations have reported 
resuils of the Achievement Testing Program con- 
ducted by the Annual Survey of Hearing Impaired 
Children and Youth in ihe spring of 1971.^ Apart 
from age and degree of hearing loss** the lesi results 
have not yet been presented in terms of their relation- 
ship with other basic variables upon which a data file 
is maintained for all students participating in the 
Annual Survey. 

The purpose of this rept^rt is limited to displaying 
the association between the test scores for four 
selected ages on the Paragraph Meaning and 
Arithmetic Computation Sub-tes!s of the Stanford 
Achievement Test and the following variables: sex. 
propi>rtion of the schcx)! day spent in special educa- 
tional classes, type of special educational program, 
age beginning formal education, age at onset of hear- 
ing loss, hearing status of parents, degree of hearing 
loss, non-verbal IQ, and additionj! handicapping 
conditions. The relationships are presented as a sim- 
ple function of dichotomizing as nearly as possible 
e«tch of the variables and calculating a mean and a 
standard deviation for each resulting group of 8, 1 1, 
14, and 17 year old hearing impaired students in spe- 
cial educational programs (or whom the data were 



'Sec rtHitnotcs I ;ind ^ on pvigc 2. 

*Sec Annual Survey publicalioa Series I). Num^er 9. 
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reported on a given variable during the 1970-71 school 
year. 

In some cases, such as sex. the criterion for 
dividing the scores into two contrasting groups is 
clear-cut. in other cases, there is a necessary arbl- 
trary element in the choice of a criterion. Thus, for 
instance. **before six years old" and **six years and 
after'* are (he reasonable but not necessary calegoriejC 
associated with the varialle> "age beginning formal 
education/' The criteria used to dichotomize each of 
the variables will be specified in the presentation of 
the results; and. where necessary, the rationale for 
the choice will be indicated. 

The results are presented for the Paragraph Mean- 
ing and Arithmetic Computation Sub-tests because 
these !wo sub-tests ordinarily provide the lowest and 
highest scores for hearing impaired students and 
because they are sub-tests common to all five levels 
of the l%4 edition of the Stanford Achievement 
Test.'' Also* it should be noted that the means re- 
ferred to are grade equivalents and represent the 
weighted results for all of the batteries taken by each 
of the ages for which scores are reported. Thus, for 
instance, the means for 17 year old students result 
from weighting the means in terms of the number of 



Mn thc^ Prinuify \ HuHay Arithmetic Compnt^^tton 
appciirv iis imc of Ihc four scctiiuis o( ihc AiilhmcUc Sub- 
ICM- 



17 yciir old sludcnls who look each of ihe five bat- 
teries of ihe Stanford series. 

Background informalion on the achievemeni test- 
ing program from which these results are drawn and 
a statement of the limitations associated with the use 
of these data appear as Appendix II of this publica- 
tion. Limitations associated with the validity and 
reliability of the data on the variables used in this 
report uM\y be found in the Annual Survey^s D-IO 
publication.* 

In concluding this introduction, the very limited 
purpose of this report should be emphasized. Mere 
associations between test results and dichotomized 
variables for selected ages arc discussed; there is no 
suggestion that such associations represent the basis 
for causal statements. Thus, for instance, the fact 
that the scores for students who are reported to have 
attended preschool programs are higher than those 
for students who did not attend such programs is not 
in itself an adequate basis to conclude that attendance 
in preschool programs causes mcreased academic 
achievement for hearing impaired youngsters. Stu- 
dents w ho did and those w ho did not attend preschool 
programs differ in other regards, and these differ- 
ences undoubtedly play some part in determining the 
divergences in the scores of these two groups. 

Plans are underway to submit the data which 
serve as the basis of this report to more sophisticated 
and nieaningfui statistical analysis. The limited 
results to be found here are being published because 
it will be some lime before the planned analysis can 
be completed; and in the meantime, these results may 
serve as a basis for suggesting types of specialized 
analyses that researchers in the field of educating 
hearing impaired youth may wish to request of the 
Annual Survey. 

HIGHLIGHTS OF 
THE RELATfONSHIPS 

In this section graphs will be used to highlight 
the relationships between nine selected variables and 
the achievement test scores of 8. II, 14, and 17 year 
old hearing impaired students on the Paragraph 
Meaning and Arithmetic Computation vSub-tcsts, The 
results for each of the sub-tests will be presented in 
parallel graphs; in this way the results for each of the 
groups which emerge from dichotomizing a variable 
can be compared on the two sub-tests simultane- 
ously. 

All of the results discussed in this section and 
the next derive from Detailed Tables A and B which 
appear at the end of this report. In both of these sec- 
tions the scores for the groups for whom information 
was not available on a given variable yre omitted. The 



K^hartu fenstii s of Heani)}^ Impaired Studt nts h\ lieor- 
ini( Status. United Slates: f970'7L Gallaudet College. 
Office of IXmogniphic Studies. Scries D. Number \Q, pp. 



scores and the standard deviations for these 
'•unknown'* groups do appear in the tables at the end 
of the report. Since the means for the **unknown** 
group do not always fall between the means for the 
groups dichotomized for a given variable, it cannot 
be assumed that the '^unknowns*' are distributed like 
the/'knowns'' for all variables. This fact should be 
taken into account in any attempt to interpret the 
results for any given variable. As may be noted in 
the Detailed Tables, age beginning formal education, 
hearing status of parents, degree of hearing loss, and 
non-verbal l,Q., all have high percentages of students 
for whom data were not reported. In addition, the 
total number of students included in each of the 
groups we will be considering may be found in these 
tables. 

SEX 

In the hearing population females ordinarily out- 
perform males in the Paragraph Meaning Sub-test of 
the Stanford Achievemeni Test.* As may be seen in 
Figure 1» this relationship is reflected in the scores 
of the hearing impaired students included in this 
study. On the other hand, males in the hearing popu- 
lation tend to outperform females on the Arithmetic 
Computation Sub-test, As the graph indicates, this 
relationship does not hold true for the hearing 
impaired group, except for the 17 year old students. 
In any case, the differences between the performance 
of males and females are exlremeiy small, never 
exceeding more than two-tenths of a grade, 

PROPORTION OF 

THE SCHOOL DAY SPENT 

IN SPECIAL EDUCATIONAL CLASSES 

Figure 2 shows the relationships between the test 
scores and proportion of the school day spent in spe- 
ci;0 ckisses. For this variable, "fuli-iime" refers to 
students in residential and day schools and in full- 
time classes for the heitring impaired. "Part-time" 
refers to students who nre in part-lime classes, who 
i\rc in itinerant programs, or who have access to a 
resource room. 

This variable is among those showing the larger 
differences in the mean scores between the two 
groups. The difference is least for 8 year old students 
and is especially pronounced for the Paragraph 
Meaning Sub-test. 

Consideration of this variable may serve as i» 
reminder of the eariier statement that claims regard* 
ing relationships based on Ihe data in this report 
should not be interpreted as causal statements. Stu- 
dents in part-time special educational programs are 
known to have less of ii hearing loss on the average 



^Kelley, T. L., Madden. R.. Gardner. H. F., Rudn\an. 

H, C Shifift>rd Aihii'M metu Test Tirhtihaf S{({tpU nwnt. 
New York: Harcourt. Brace Sc World. Inc.. l%6, p. 29. 
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FIGUflE 1: MEAN GRAOE EQUIVALENT SCORES fOR ALL BATTERIES AND SELECTED AGES BY 
SEX FROM THE ANNUAL SURVEY'S t971 ACHIEVEMENT TESTING PROGRAM, 
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*=l6URe 2: MEAN GRADC ECUiVALENT SCORES FOR ALL BATTERIES AND SELECTED AGES BY 
PROPORTION OF THE SCHOOL DAY SPENT IN SPECIAL EDUCATIONAL CLASSES 
FROM THE ANNUAL SURVEY'S 1971 ACHIEVEMENT TESTING PROGRAM. 
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FIGURE 3; MEAN GflADE EQUIVALENT SCORES FOR ALL BATTERIES AND SELECTED AGES BY 
TYPE OF SPECIAL EDUCATIONAL PROGRAM FROM THE ANNUAL SURVEY'S 1971 
ACHIEVEMENT TESTING PROGRAM. 
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than students in full-time programs,^ and part of the 
difTerence between ihe scores for these two groups 
undoubtedly derives from this fact. Other differences 
which affect educational outcome exist between stu- 
dents in these iwo types of programs, and ji is there- 
fore not legitimate on the basis of these data alone 
to conclude that parlicipation in regular classes 
enhances the academic achievement of hearing 
impaired students. 

TYPE OF PROGRAM 

A comparison of scores for students in **resi- 
dentiaP' and **non-residential" programs ap- 
pears in Figure 3. U should be emphasized that the 
comparison here is based on Ihe type of program and 
not on the type of student. Thus, day students in 
residential programs are included under the category 
^'residential program/* Further, it should be noted 
that a proportion of the students in the *'non- 
residential'* program category are receiving only part- 
time special educational services. Since these part- 
time students ordinarily receive higher achievement 
test scores, part of the difference between the mean 
grade equivalent scores of students in residential 
programs and students in day programs is due to their 
inclusion in the latter group. 

•See AnnuaJ Survey publication D-10, p. 12. 
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AGE BEGINNING 
FORMAL EDUCATION 

For n, 14, and 17 year old students, the scores 
of those who attended preschool programs are 
between two-tenths and five-tenths of a grade higher 
on the Paragraph Meaning Sub-test and between five- 
tenths and one and two-tenths of a year higher on the 
Arithmetic Computation Sub-test. However, as m^ay 
be noted in Figure 4, the scores for 8 year old stu- 
dents are approximately equal. In fact, the 8 year old 
students who are reported not to have attended a for- 
mal educational program prior to their sixth year 
score about one-tenth of a grade higher on the Para* 
graph Meaning Sub-test than do the students who are 
reported to have attended a preschool program. 

AGE AT ONSET 
OF HEARING LOSS 

Figure 5 reveals almost no differences in achieve- 
ment test scores between those students whose 
age at onset of heaiing loss was reported as ''at 
birth" and those with onset reported as '*after 
birth/' The largest difference is only four-tenths of 
a grade for 17 year old students on the Paragraph 
Meaning Sub-test, It is possible that differences 
might have appeared had the distinction *'prc- 
linguaf and "post-lmguaf' (under three years of age 



FIGURE 4: 



MEAN GRADE EQUIVALENT SCORES FOR ALL BATTERIES ANO SELECTED AGES BY 
AGE BEGINNING FORMAL EDUCATION FROM THE ANNUAL SURVEY'S 1971 ACHIEVE- 
WENT TESTING PROGRAM. 




FIGURE 6: MEAN GRADE EQUIVALENT SCORES FOR ALL BATTERIES AND SELECTED AGES BY 
AGE AT ONSET OF HEARING LOSS FROM THE ANNUAL SURVEY'S 1971 ACHIEVEMENT 
TESTING PROGRAM. 
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and three ycius of age or older, for instance) been 
used to dislin^juish Ihc two groups. 

Table I indicates the distribution by age at onset 
of those students ih the Achievement Testing Pro- 
gram on whom data were reported for this variable. 
As may be noted, only a very small proportion of 
these students has a posl-lingual age at onset of hear- 

TABLE1: DISTRIBUTION BY AGE AT ONSET 
OP HEARING LOSS Of= STUDENTS IN 
THE ANNUAL SURVEY'S 1971 
ACHIEVEMENT TESTING PROGRAM. 



Students in the 
Achievement 
Testing Program 



Age at Onset 


Number 


Percent 


Total Students 


16,908 


100.0 


Information Not Reported 


2.319 


13.7 


Total Reported 


14.589 


100.0 


Birth 


11.26^ 


77.2 


After Birth but Under 3 






years 


2.541 


17,4 


3 Years and Over 


779 


5.3 



ing loss. Because the pre-linguafpost»lingual 
dichotomy would have produced so few scores for 
the posl-lingual group, the distinction between **onset 
of hearing loss at birth*' and all other onsets {'*onsel 
of hearinn loss after birth'') was used to distinguish 
the groups. 

HEARING STATUS OF PARENTS 

This variable, as can be seen in Figure 6, was 
broken down into **at least one deaf parent" and **no 
deaf parent(s)" and was based on whether ihe 
student's mother or father had normal hearing or a 
hearing impairment prior to age six. If on the survey 
questionnaire one parent was marked as '^deaf and 
the other was "unknown/' then the student was clas- 
sified as having **at least one deaf parent"; if, on the 
other hand, one parent was marked as "hearing" and 
the other as "unknown," then the student was placed 
in the "unknown" category. Only if both parents 
were marked as "hearing'' was the student placed in 
the "no deaf parents" category. 

The results for this variable are in line with the 
finding of other research showing the relationship 
between the performance of hearing Impaired stu- 
dents of deaf parents and those of hearing parents. 
Again, it should be emrhaslzcd that the data support 
this finding only in the context of students attending 
special educational program i. To the degree that 



FIGURE 6: MEAN GRADE EQUIVALENT SCORES FOR ALL BATTERIES AND SELECTED AGES BY 
HEARING STATUS OF PARENTS FROM THE ANNUAL SURVEY'S 1971 ACHIEVEMENT 
TESTING PROGRAM, 




FIGURE 7: MEAN GRADE EQUIVALENT SCORES FOR ALL BATTERIES AND SELECTED AGES BY 
DEGREE OF HEARING LOSS FROM THE ANNUAL SURVEY'S 1971 ACHIEVEMENT TEST* 
ING PROGRAM. 



PARAGRAPH MEANING ARITHMETIC COMPUTATION 




AGE AGE 



hearing parents arc more likely lo send their hearing 
impaired children — especially if he or she is bright 
— to a regular school program than would the deaf 
parents of a hearing impaired child> the students 
reported on in this article cannot be said to reflect 
a representative group of hearing impaired students- 
In interpreting the results for this variable special 
caution should be exercised for another reason. As 
may be seen in Detailed Tables A and B, for some 
a! yet unexplained reason and contrary to usual 
expectations, the means for the "unknown" group 
consistently fall below the means for the students 
w ith at least one deaf parent and for the students with 
hearing parents. This occurs on both the Paragraph 
Meaning and the Arithmetic Computation Sub-tests, 
This strongly suggests that the characteristics of the 
students for whom information was not reported on 
this variable are not the same as for the students on 
whom the data were reported, 

DEGREE OF HEARING LOSS 

The results for this variable are shown in E^'igure 7. 
Ihcy arc presented here so that the reader may 
examine the relationships regarding this variable in a 
formal similar to that used for the olhcr variabfes. 
llowevcr, more detailed results regarding the relation- 

ERIC 



ship between degree of hearing loss, age, and achieve- 
ment lest scores may be found in a previous publica- 
tion of the Annual Survey, Academic Achievement 
Test Resuiis of a National Testing Program for Hear- 
ing impaired Students, United States: Spring 1971 
(09), 

The results in that publication are presented in 
terms of three categories of hearing loss: 59dB and 
below/ 60-98dB, and 99dB and above; in general, 
these results suggest that the differences in scores 
based on hearing threshold levels derive mostly from 
the *'59dB and below'' category, which contains a 
proportionally small number of students. Thus, much 
of the association between the degree of hearing loss 
and achievement test scores is masked in Figure 7 
by the fact that the major proportion of the students 
in the 'less than 85dB** category have hearing losses 
between 60 and 84dB. 

In general, then, the relationships depicted in 
Figure 7 tend lo underestimate the influence of the 
lower levels of hearing loss on the test scores. 



^All Jecibel levels arc given for ihe LSO standard. 
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NON«VERBAL I.Q. SCORES* 

Not unexpectedly, as can be seen in Figure 8» 
this is the variable showing the largest difference 
between the two contrasted groups. The association 
between I.Q. scores and achievement test scores is 
well known. What is somewhat surprising is that the 
pattern of the results between the two sub-tests for 
this variable does not differ slgnificanliy from the 
other variables we have considered. 

One might expect that since the intelligence of 
the students is being measured by a relatively non- 
verbal procedure and the Arithmetic Compulation 
Sub-test has a far lighter language load than does the 
Paragraph Meaning Sub-test, the differences between 
the two groups of students would be extremely [arge 
for the Arithmetic Compulation Sub-test and rela- 
tively small in the Paragraph Meaning Sub-test where 
the language load is obviously heavy. 

It should be emphasized that the difference in 
achievement lest scores between the high and low I.Q. 
groups is greater on the Arithmetic Compulation Sub- 
test than on the Paragraph Meaning Sub-test, and it 



•The LQ. scores discussed here arc those thai were 
reported to the Annual Survey from the individual schools 
and programs in the Survey; moreover, since thc^ I.Q. 
scores were derived from different tests, which consequently 
have different norms, care should be exercised in the 
interpretation of the data in this section. 



is only the fact that it is not far greater that is being 
noted. 

ADOITiONAL 

HANDICAPPINQ CONDITIONS 

In Figure 9 the results regarding this variable 
indicate a relatively large difference between the 
scores for the hearing impaired student with no addi- 
tional handicapping condition and those for the multi- 
ply handicapped hearing impaired student. 

These results offer support for the contention that 
studies relating to hearing impaired students should, 
whenever possible, distinguish between the multiply 
handicapped hearing impaired youngster and the hear- 
ing impaired youngster with no additional haridicaps. 
Such a consideration takes on added significance when 
it is recognized that more than one-quarter of the stu- 
dents on whom the Annual Survey receives data for 
additional handicaps are reported as having one or 
more handicaps in addition to their hearing impair- 
ment. 

On the other hand, aside from the magnitude of 
the difference » the pattern of the results for this vari- 
able resembles that of most of the other variables we 
have already considered in that (I) the scores for both 
groups on both sub-tests are similar for the 8 year 
olds« and (2) the improvement in scores at the higher 
ages is much more marked on the Arithmetic Compu- 
lation Sub-test than on the Paragraph Meaning Sub- 
test. 



figure 8: mean grade equivalent scores for all batteries and selected ages by 
Non-verbal i.q. from the annual survey's 1971 achievement testing 

PROGRAM. 
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FIGURE 0: MEAN GRADE EQUIVALENT SCORES FOR ALL BATTERIES AND SELECTED AGES BY 
ADDITIONAL HANDICAPPING CONDITIONS FROM THE ANNUAL SURVEY'S 1971 
ACHIEVEMENT TESTING PROGRAM, 
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SUMMARY: 

OVERALL DIFFERENCES 

In the previous sections we have viewed two 
lypcs of differences for contrasting groups of students 
in the Annual Survey's 1971 Achievement Testing 
Program in relation to selected ages. The first type 
of difference related to how ihe mean grade equiva- 
fenl sc<ues for the two groups of students differed on 
each of two sub-tests of the Stanford Achievement 
Test. The second related to a comparison of these 
differences between the Paragraph Meaning and 
Arilhmetic Computation Sub-tests. 

If we disregard age and average the differences 
for the four ages for each variable and each sub-test, 
wc obtain the resulls shown in Chart I, These resulls 
merely summarize the data discussed in the previous 
section. They may be viewed either m terms of the 
average difference between the scores for each sub- 
test or in relation to whether the differences are great- 
er or less for the Paragraph Meaning or Arithmetic 
Computation Sub-tests. 

Averaging the results of the two sub-tests for 
each variable, we may rank the first type of differ- 
ences from those variables where the two groups 
score approximately equaMy to those in which there 
is a great difference between the scores for each 
group. 

o 

ERIC 



Chart 1 indicates the ranking of the difference 
betweert the differences of the two groups for each 
variable when grade equivalents are calculated by 
dichotomizing the students* scores, subtracting the 
lower score from the higher^ and averaging the differ 
ences for the four ages. As may be noted» the larger 
differences appear for non-verbal I,Q., proportion of 
the school day spent in special educational classes, 
and additional handicapping conditions. The smallest 
difference appears for age at onset of hearing loss. 

The ranking of these differences is based on 
averaging the differences for the Paragraph Meaning 
and Arithmetic Computation Sub-tests, When the 
relative size of these differences for each of the vari- 
ables for each sub-test is considered, the resulls 
shown in Table 2 arc obtained. Age at onset cannot 
be classified because it is not consistent in terms of 
the dichotomizalion. with the ''after birth'' group 
scoring higher than the "al birth" group on the Para- 
graph Meaning Sub-test and the **al birth" group scor- 
ing higher on the Arithmetic Computation Sub-test. 

Speculative reasons could be offered us to why 
the diffe-ences between the differences are greater for 
the Parcgraph Meaning Sub-test on some variables 
and greater for the Arithmetic Computation Sub-test 
on other variables. However, for the limited purposes 
of this report it is judged sufficient ntcrely to have 
highlighted this aspect of the results. 
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CHART 1: RANKING OF THE DIFFERENCE BETWEEN THE MEAN DIFFERENCES OF PARAGRAPH 
MEANING AND ARITHMETIC COMPUTATION SUB-TESTS OF THE STANFORD ACHIEVE- 
MENT TEST FOR THE 8, 1 1, 14, AND t7 YEAR OLD AGE GROUPS. 



MEAN DIFFERENCES 



Age at Onserof Hearing Loss: 
Paragraph Meaning— After Birth ov^er Birth 
Arithmetic Computation— Birth over After Birth 



Sex: Females over Mates 



Degree of Hearing loss (BEA): Less than 85 dB 
over 85 dB and Greater (iSO) 



Type ol Special Educational Program: Students 
in Non Hesideniial Programs over Students in 
Residential Programs 

Hearing Status of Parents: At Least One Ooaf 
Parent over No Deaf Parent(s) 



Age Beginning Formal Education: Before 6 Yrs. 
Old over 6 Yrs, and After 



Additional Handicapping Conditions; No Addi- 
- tional Handicapping Condition over At Least 
One Additional Handicapping Condition 



Proportion of the School Day Spent in Special 
Educational Classes: Part Time over Full 
Time 



Non-Verbal I.Q.: 96 and Greater 1.0. ov^er Less 
than 96 I Q 



H Paragraph Meaning 
Arithmetic Compulation 




11.35 



.10 .20 .30 .40 .50 .60 .70 .80 ,90 1.00 1.10 1.20 1.30 1,40 



TABLE 2: RANKING OF VARIABLES RELATIVE TO THE TYPE^ANO SIZE OF THE DIFFERENCES BE- 
TWEEN THE SCORES FOR THE PARAGRAPH MEANING AND ARITHMETIC COMPUTATION 
SUB TESTS OF THE STANFORD ACHIEVEMENT TEST: SPRING 1971 



Differences In 
Paragraph Meaning Greater 


Amount of 
Difference in 
Grade Equivalents 


Differences In 
Arithmetic Computation Greater 


Amount of 
Difference in 
Grade Equivalents 


1. 


Proportion of School Day Spent 




K Non-Verbal 1.0. 


0.55 




in Special Educational Classes 


0.19 




2. 


Degree of Hearing Loss 


0.1B 


2, Additional Handicapping 










Conditions 


0.39 


3. 


Sex 


0.12 


3, Age Beginning Formal 










Education 


0.37 








4, Hearing Status of Parents 


0.19 








5. Type of Special Educational 










Program 


0.17 



2 



TABLE A: NUMBER, MEANS, AND STANDARD DEVIATION OF THE PARAGRAPH MEANING SUB-TEST 
OF THE STANFORD ACHIEVEMENT TEST AS ADMINISTERED TO 8, 11, 14. AND 17 YEAR 
OLD HEARING IMPAIRED STUDENTS IN PARTICIPATING SPECIAL EDUCATIONAL PRO- 
GRAMS FOR THE HEARING IMPAIRED: UNITED STATES, 1970-71 SCHOOL YEAR. 





8 Y«ar Old Students 


II Year Old Students 


14 Year Old Students 


17 Year Old Students 








Sun 






Sun 






Sun 






SUn 


— - — ■ ~ 


N 


Mean 


Dev. 


N 


Mean 


Dev« 


N 


Mean 


Dev. 


N 


Mean 


Dev. 


Set 
Male 




1 QA 




O^O 






0.86 


834 




3.06 


1.44 


676 


3.93 


1.88 


Female 


1 




n RQ 




lAl 


0.87 


732 


3.32 


1.39 


S63 


4.12 


1.82 




n 
u 






U 






0 






0 






f ntat 






n ^R 


IRQ A 




U.o/ 


lobb 


0 1 0 

J.lo 


1.42 


1239 


4.02 


1,86 


(Proportion of the School Day 


























Spent in Special Educational 


























Classes 


























Full Time 


616 


1.84 


0.43 


1S12 


2.3S 


0.80 


1476 


3.09 


1.34 


1162 


3.93 


1.81 


Part Time 


74 


2.42 


1.05 


82 


3.37 


1.41 


90 


4.59 


1.91 


77 


5.36 


2.06 


Unknown 


0 


— 




0 


— 




0 


*• 


- 


0 






Total 


690 


K90 


0.56 


IS94 


2.40 


0.87 


1566 


3.18 


1.42 


1239 


4.02 


f.86 


type of Special Educational 


























Pfogrem 


























Students in Residential 


























Programs 


196 


1.82 


0.40 


739 


2.27 


0.68 


946 


2.99 


1.21 


866 


3.90 


1.79 


Students in Non-Residential 




















Programs 


494 


1.93 


0.62 


855 


2.51 


0.39 


620 


3.47 


1.65 


373 


4.30 


1.97 


Unknown 


0 






0 


— 


— 


0 


- 




0 


- 


— 


Total 


690 


1.90 


0.56 


1594 


2.40 


0.87 


1566 


3.18 


1.42 


1239 


4.02 


1.86 


Age Beginning Formal 


























Education 


























Before 6 Yrs. Old 


504 


1.90 


0.S1 


872 


2.48 


0.91 


689 


3.30 


1,32 


504 


4.26 


1.83 


6Yrs. and After 


70 


1.96 


0.93 


358 


2.28 


0.83 


432 


2.83 


1.21 


339 


3,87 


2.01 


Unknown 


116 


1.88 


0.51 


364 


2.33 


0.79 


445 


3.32 


1.6» 


396 


3,84 


1.70 


TolaJ 


690 


1.90 


0.56 


1S94 


2.40 


0.87 


1566 


3.18 


1.42 


f239 


4.02 


1.86 


Age at Onset of Hearing Loss 


























Onset of Hearing Loss 


























at Birth 


446 


K93 


0,59 


1071 


2.41 


0.87 


1055 


3.17 


1.39 


788 


3.94 


1.74 


Onset of Hearing Loss ^ 






















After 8irth 


158 


1.88 


0.56 


288 


2.38 


0.96 


294 


3.18 


1.56 


285 


4.32 


2.22 


Unknown 


OD 


1 Q 1 

1.0 1 


U.*tU 


COO 


0 1C 
£.J0 


U. /o 


217 


j.Zf 


14 1 

1.42 


166 


3.86 


1.66 


Total 


con 




U.DD 


1594 


2.40 


0.87 


1566 


3.18 


f.42 


1239 


4.02 


1.86 


Hearing Status of Parents 


























At Least One Deaf Parent 


50 


1.95 


0.38 


107 


2.69 


0.89 


109 


3.67 


1.52 


74 


4.56 


1.90 


NoOeaf Parent(s) 


466 


1 92 


0.62 


941 


2.44 


0.88 


961 


3.22 


1.40 


847 


4.12 


1.91 


Unknown 


174 


1.85 


0.44 


B46 




0.82 




£.90 


1 .*l£ 


71 Q 


1 R9 


1 .0 1 


Total 


690 


1.90 


0.56 


1 99 *t 




n fi7 


1 RRR 


a. 10 




1cJ9 




1 QC 

l.ob 


Degree of Hearing Loss (8EA} 


























Less Than BSdBdSOl 


258 


2.03 


0.73 


543 


2.56 


1.07 


497 


3.44 


1.60 


372 


4.34 


201 


8SdB & Greater (ISOl 


304 


1.83 


0,40 


771 


2.30 


0.68 


768 


3.05 


1.36 


696 


3.89 


1.76 


Unknown 


128 


1.81 


0.4S 


280 


2.35 


0.85 


301 


3.07 


1.20 


171 


3.84 


1.80 


ToU( 


690 


1.90 


0.56 


1694 


2.40 


0,87 


1588 


3.18 


1.42 


1239 


4.02 


1.86 


Non-Verbatl.Q. 


























Less Than 96 I.Q. 


140 


1.64 


U.o4 


460 


2.12 


0.66 


505 


2.71 


1.14 


397 


3.19 


1.33 


96 & Greater I.Q. 


249 


1.94 


0.49 


519 


2.62 


097 


548 


3.55 


1.43 


471 


4.73 


1.98 


Unknown 


301 


1.99 


0.66 


615 


2.43 


0.86 


513 


3.24 


1.54 


371 


4<00 


1.80 


Total 


690 


1.90 


0.56 


1594 


2.40 


0.8/ 


1566 


3.18 


1.42 


1239 


4.02 


1.86 


Additional Handicapping 


























Conditions 


























No Additional Handicapping 


























Condition 


463 


1.93 


0.55 


991 


2.53 


0.90 


958 


3.35 


1.40 


806 


4.37 


1.92 


At Least One Additional 
























Handicapping Condition 


137 


1.74 


0.42 


388 


2.11 


0.75 


396 


2.69 


1.15 


289 


3.13 


1.43 


Unknown 


90 


2.01 


0.74 


215 


2.33 


0.78 


212 


328 


1.75 


144 


3.80 


1.57 


Total 


690 


1.90 


0,56 


1594 


2.40 


0.87 


1566 


3.18 


1.42 


1239 


4.02 


1.86 



/ ■ ■ ■ 

TABLE B: NUMBER, MEANS, AND STANDARD DtViATION OF THE ARITHMETIC COMPUTATION SUB- 
TEST OF THE STANFORD ACHIEVEMENT TEST AS ADMINISTERED TO 8, 11, 14, AND 
17 YEAR OLD HEARING IMPAIRED STUDENTS IN PARTICIPATING SPECIAL EDUCATIONAL 
PROGRAMS FOR THE HEARING IMPAIRED: UNITED STATES, 1970-71 SCHOOL YEAR. 





1 Ye 


er Old Students 


11 YeerDldSttidenU 


1 14 Yeer Old Students 


17 Ye< 


\t Old Students 






Mean 


Sun 






Stan. 






Stan. 






Stin 




N 


Oev. 


H 


Meen 


Dev. 


H 


Meen 


Dev, 


N 


Mean 


Dev. 


Sex 


























Male 


339 


1.82 


0.56 


842 


2.84 


1.34 


833 


4.37 


2.13 


677 


R in 


C.9 1 


Fimatt 


329 


1.89 


0.63 


741 


2.94 


1.34 


727 


4.57 


1 Q7 


565 


S Qd 


c.OO 


Unknown 


0 






0 






0 






0 






Total 


668 


1.85 


0.60 


1583 


2.88 


1.34 


1560 


4.46 


2.04 


1242 


ft 01 


C.*tO 


Proportion of tha Schoof Day 


























Spant in Special 


























Eduutio/^al Classes 


























FuHTIme 


S9S 


1.79 


0.53 


1501 


2,82 


1.32 


1469 


4.39 


2 01 


1165 






Part Time 


73 


2.38 


0,86 


82 


4.00 


1.35 


91 


5.68 


2.00 


77 


6.72 


7 02 


Unknown 


0 






0 






0 






0 






Total 


668 


,1.85 


0.60 


1583 


2.88 


1.34 


1560 


4.46 


2.04 


1242 


6,03 


2.43 


Tvpe of Special Educational 


























Program 


























Students in Residential 


























Programs 


m 


1.67 


0.47 


731 


2.64 


1.19 


942 


4,22 


1.92 


869 


5.85 


2.44 


Students in Non-Residentfal 




















Programs 


485 


1.92 


0.63 


852 


3.10 


1.43 


618 


4,84 


2.15 


373 


6.43 


2,36 


Unknown 


0 






0 






0 






0 






lotai 


668 


1.85 


0.60 


1&83 


2.88 


1 34 


1560 


4.46 


2.04 


1242 


6.03 


2.43 


Age Beginning Formal 


























Education 


























Before 8 Yrs Old 


486 


1.85 


0.55 


871 


3.00 


t.38 


688 


4.87 


2.04 


607 


6.51 


2.40 


6 Yrs. end After 


68 


1.91 


0.83 


353 


2.84 


L22 


430 


3.73 


1.75 


339 


5.46 


2.32 


Unknown 


114 


1.84 


0.65 


359 


2.84 


1.33 


442 


4.55 


2.09 


396 


5.90 


2.44 


lotai 


868 


1.85 


0.80 


1583 


2.88 


1.34 


1560 


4.46 


2.04 


1242 


6.03 


2.43 


Age at Onset of Hearing Loss 


























Onset of Hearing Loss 


























At Birth 


434 


1.87 


0.59 


1064 


2.93 


1.36 


1050 


4.52 




791 


R no 


9 A7 


Onset of Hearing Loss 






















After Birth 


148 


1.86 


0.71 


288 


2.81 


1.35 


294 


4.33 


1.96 


285 


6.21 


2.41 


Unknown 


86 


1.76 


0.41 


231 


2.75 


1.24 


216 


4.40 


2.12 


166 


5,84 


2.48 


Total 


Quo 


1.85 


0.60 


1583 


2.88 


1.34 


1560 


4.46 


2.04 


1 Oil 0 


6,03 


2.43 


Hearing Status of Parents 
























• "■* 


At Least One Deaf Parent 


49 


1.96 


0.51 


106 


3.53 


1.40 


110 


5.10 


1.98 


74 


6.93 


2.44 


No Deaf Parentis) 


447 


1.87 


0.63 


935 


2.93 


1:33 


955 


4.63 


2!04 


850 


6!l4 


2^42 


Unknown 


172 


1.78 


0.53 


542 


2.68 


1.31 


495 


4.01 


1.94 


318 


5,51 


2.35 


Total 


668 


1.85 


0.60 


1583 


2.88 


1.34 


1560 


4.46 


2.04 




6,03 


2.43 


Degree of Hearing LosslBEA) 


























Leu Than 8$dB (ISO) 


251 


2.00 


0.75 


539 


3.04 


1.41 


493 


4.51 


2.00 


373 


6.05 


2.24 


obQo & Greater (iSOJ 


294 


1.76 


0.46 


764 


2.78 


1.25 


765 


4 41 


2.08 


698 


6.05 


7 42 


Unknown 


123 


1.75 


0.48 


280 


2.89 


1.42 


302 


4,53 


1.97 


171 


5,89 


2,83 


Total 


668 


1.85 


0.60 


1S83 


2.88 


1.34 


1560 


4,46 


2.04 


1242 


6.03 


2.43 


Non-Verbal LQ. 


























Less Than 9S I.Q. 


134 


1,55 


0.42 


456 


2.37 


t.09 


502 


3,51 


1.64 


398 


4.78 


2.02 


96 & Greater I.Q. 


239 


1.89 


0.51 


517 


3,27 


1.40 


546 


5,34 


1.88 


472 


7.11 


2.32 


Unknown 


295 


1.95 


0.68 


610 


2,94 


1,35 


512 


4.46 


2.12 


372 


5J8 


2.32 


Total 


668 


1.85 


0.60 


1583 


2,88 


1.34 


1560 


4,46 


2.04 


1242 


6.03 


2.43 


Additional Handicapping 


























Conditions 


























No Additional Handicapping 


























Condition 


450 


1.87 


0.60 


988 


3.07 


1.38 


957 


4.82 


1.^9 


809 


6.58 


2,27 


At Letst Dne Additional 
























Handicapping Condition 


129 


1,72 


0.60 


384 


2,43 


1.16 


391 


3.61 


1.84 


289 


4.52 


2.19 


Unknown 


89 


1.96 


0.58 


211 


2,83 


1,28 


212 


4.43 


2.11 


144 


5,92 


2.45 


Total 


668 


1.85 


0.60 


1583 


2.88 


1.34 


1560 


4.46 


2.04 


1242 


6.03 


2.43 
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Guessing or "Chance" Level Responses 
on the Stanford Achievement Test, 
Hearing Impaired Students: United States, Spring 1971 



Raymond J. Trybus and Peter J. Seplelll 
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INTRODUCTION 

The results from the flrsl National Achievement 
Testing Program conducted by the Office of Demo- 
graphic Studies in spring, 1969, indicated that many 
students were being tested with battery levels beyond 
their ability, with many scores falling in the **chance'* 
or **guessing*' range as a result. The second National 
Achievement Testing Program, conducted in spring, 
1971, utilized a screening test procedure as a basis 
for assignment of the battery level at which students 
were to be tested. This procedure was designed lo 
reduce the incidence of guessing level scores and 
thereby increase the usefulness and accuracy of the 
resulting scores. 

This study examines the results of the scores 
from the 1971 testing program in order to d<*?ermine 
the frequency of occurrence of scores at or below the 
theoretical chance level and the likelihood that these 
scores did in fact result from performances indis- 
tinguishable from guessing. The question of guessing 
on standardized tests is a concern in aH areas of test- 
ing with multiple-choice items, and it has been of 
interest in regard to the testing of hearing impaired 
students (Elliott and Healey, 1970). Since this ques> 
tion is of interest to so many teachers and other test- 
users» it can be of substantial value to have factual 
data in this regard for hearing impaired students. 

The focus of this study is empirical and descrip- 
tive rather than theoretical. Nevertheless, because of 
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the importance which the question of guessing has 
assumed, the following review of the literature will 
consider theoretical issues as well as empirical ones. 

REVIEW OF THE LITERATURE 

The question of guessing on achievement tests 
written in multiple-choice format has been a topic of 
consideration at least since McCall (1920) introduced 
a **correciion for guessing'* in his "new kind of 
school examination.'* Since then the debate on 
whether or not to correct for guessing or chance suc- 
cess has continued unabated, and studies of one or 
another sort relating to guessing have appeared reg- 
ularly in the literature. 

In terms of practical implications, the question of 
guessing has at least two major aspects: 

(1) considerations regarding the degree to which 
guessing or random response has inflated resulting 
test scores across the score range, along with 
methods for correcting for this inflation; related con- 
cerns are the effects of guessing, and of correction- 
for-guessing formulas, on test reliability, validity, and 
item statistics; in these considerations guessing is 
taken to be one of several possible determinants of 
the answer marked by the examinee (Garvin, I97I), 
along with knowledge, partial knowledge, misinfor- 
mation, response sets, etc.; 

(2) considerations regarding the extent and fre- 
quency of guessing as a factor lo be considered in 
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determining the ;ippropriiile testing level for tests 
with muNiple difficudy levels; in this regi^rd the con- 
centration is on the extent of occurrence of scores 
whose sole or miijor component is guessing or 
chance. 

This review of the related research will dea! tust 
v\ith the considerations listed under t!), then move 
to the considerations under (2) as the concerns nune 
directly relevant to this study. 

An extensive review of the literature related to 
(I) above has appeared recently (Diamond & Eivans, 
1973), and as a result only brief mention will be made 
here of this area of concern. 

The correction-for-guessing formula is 

where S^; is the corrected scoie, R is the number 
of items answered correctly « W is the number of 
items answered incorrectly, and N is the number of 
response options per item. While use of the formula 
will mean lower absolute scores on an achievement 
test. vStanley (1954) and E^.bel (1965) pointed out that 
the rank ordering of a group of students by means 
of corrected and uncorrected scores will approach 
identity as the number of items omitted by each stu- 
dent approaches a constant value, Jackson (1955) 
found that a ''rights-only" score and three different 
corrected scores all had approximately the simie cor- 
relation with two estimates of the student's "true 
score/* and he concluded that the simplicity of the 
"rights-only" score made it the most appropriate 
choice. Little and Creaser (1966) showed that items 
about which the student was uncertiiin were more 
often correct than wrong, and that therefore it is 
unfair to penali/e students for guessing. Creaser and 
Little (1967) found that formul^^cori ccled scores had 
.i hi^'hcr correlation with a * rii:his-on1> " score than 
with the ' pure knovK Ictl^^'c" score it \i his. h (he coi 
reclion is piesunuibK difi.xiCkl I iu's cimkIuJo that 
while correction fviimuliv lui^ihi f^c (iscd appro- 
priately for son\e pui poses, ihe concv W\i s^oics do not 
yield the appro\ifnatu>n (o "pure kiuwx ledge ' scores 
for which Ihey are gcneraih irUcfulcd. L^crl> 
on the other hand, asserted that the usual correction 
formula yields a close approximation to the maximum 
likelihood estimate of an individual's '•(rue score," 
assunVmg that the student cither 'knows ' or *'does 
not know" the answer and assuming that all guessing 
is completely random. 

In the actual test situation, of course, guessing is 
rarely completely random » and this fact leads to con- 
siderations of the possibility of overcorrecting or 
undercorrecting. depending on the individual test- 
taker's propensity to guess when in doubt, Slakter 
(1968) suggested that instructions and formulas 
designed to reduce guessing are differentially unfair 
to those students who are more cautious and less 
prone to mark an answer when in doubt, even though 
in fact the element of doubt may be minimal. This 
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fact introduces a new source of variance Into the test 
scores related to the student's personality and/or his 
test-taking sophistication and strategy rather than lo 
the variable being measured; this constitutes an addi- 
tional source of error variance. On the other hand. 
Lord (1964) indicated that instructions to tinish all 
items result in forced random guessing, which also 
produces an increase in error variance and a con- 
sequent decrease in validity. Cureton (1966) argued 
that correction formulas erase (he effects of consist- 
ent individual differences in response to test items, 
thus lowering reliability, Hanna (1970) argued that 
scoring only for the number right rewards examinees 
who violate the usual instructions to avoid wild 
guesses, but (o answer if there is a hunch or other 
state of uncertainly. In a theoretical article, Matison 
(1965) indicated that guessing reduces reliability even 
if it also reduces the standard error oi measuremenl. 
Frary (1969) summarized: 

. , , no very satisfactory method (of 
reducing or eliminating the guessing 
componenll has been found within the 
conventional multiple-choice lest format. 
. . . For many situations, . . . eliminating 
the guessing component of scores would 
increase reliability only at the greater 
expense of reducing validity, (p. 679) 

Let us now turn our attention to the second con- 
sideration above, in w hich the actual extent of guess- 
ing behavior resulting in scores largely determined by 
chance is in question, Hbcl (1968) found that from 
three lo eight percent of the responses to four differ- 
ent tests were based on blind guessing as determined 
from students' self-reports. He also discovered that 
on items indicated to Inr blind guesses, the proportion 
answered correctly was only very slightly better than 
chance. .Sax (1962) addressed himself to the issue of 
the normative equivalents provided in standardized 
tests for law scoics which could be obtained by 
chancC: He rcpoitod. 'oi cx.in^ple, the case of an LQ. 
lest intended foi persiMis 11 \ears old and older. If 
an U vcai M student were to lake this lest, answer- 
ing on the basis of chance aloiie, his chance raw score 
would be equal to an L(J. of 116 and a percentile rank 
of HO according to the fiormativc tables for the lest. 
In this article. Sax reviewed the normative score 
equivalents of chance level raw scores on a number 
of standardized LQ. and achievement tests, and sug- 
gested, "The test manual should report the propor- 
tion of the standardization group which does no bet- 
ter than chance and the standard deviation of chance 
scores'' (p. 57.^). This same point has been raised by 
Hllioit and Healey (1970) in relation to the selection 
of test levels for achievement testing of hearing 
impaired students. Grade equi/alent scores based on 
raw scores which are at or below the theoretical 
chance level of the test cannot be accepted as mean- 
ingful unless it is clear that the student has omitted 
most of the test items and obtained a percent correct 
which is well above the chance level on the remaining 



ilems which he has unswcrcd. While scores al or 
below chance level are not useful for determination 
of a student's academic status, they may still be of 
value for predictive purposes. ClilT (1958) inves- 
tigated the predictive ability of chance-level scores on 
Ihe Cooperative School and College Ability Tests 
and found that with some tests, chance level scores 
are as predictive of a criterion as are non-chance 
scores. Nevertheless, this is not a general conclusion, 
and the possible predictive value of such chance 
scores must be investigated under the specific condi- 
tions of use of a specific test* 

The focus of the present study is on the rates 
of occurrence of chance-level scores on the sub-tests 
of the Stanford Achievement Test administered to 
hearing impaired students and on the extent to which 
such scores actually indicate performance indis- 
tinguishable from guessing or chance responding. 

METHOD 

Subjects In the National Testing Program 

During the spring of 1971 the Office of [)emo- 
graphic Studies conducted a National Achievement 
Testing Program for hearing impaired students. 
Every educational program for hearing impaired stu- 
dents then known to the OfTice was invited to partici- 
pate. The invitation went to 776 programs, of which 
292 fmally participated and administered over 19,000 
individual achievement tests. Since participation in 



the achievement testing program was determined by 
voluntary cooperation of the programs rather than by 
sampling on a systematic basis, the resulting group 
of students, while large, cannot be called representa- 
tivl on the basis of sampling methodology, Post-hoc 
analysis of the demographic composition of the group 
of students who were tested, however, suggests that 
this group is quite comparable to the untested group 
on ail variables except age, where differences are to 
be expected since younger students are not ordinarily 
tested by means of achievement tests. Students in the 
0-9 age group constituted 14.8 percent of the tested 
group, compared to 62.0 percent of the untested 
group; of all students in the Annual Survey, 42.6 per- 
cent fell into this 0-9 age range. The demographic 
data appear in Appendix L An overall statement of 
the qualifications and limitations of all data arising 
from the 1971 testing program appears in this publica- 
tion as Appendix IL 

SutHects In This Study 

A demographic data file was available for 16,908 
of the 19,037 students tested in the 1971 program. 
From this group of 16,908 students, those individuals 
were selected whose raw score on a given sub-test 
was at or below the raw score to be expected on the 
basis of random response or guessing, with each 
alternative having an equal probability of being cho- 
sen. Table t lists the raw scores required for inclusion 



TABLE 1: RAW SCORE MEANS AND STANDARD DEVIATIONS OF THE DISTRIBUTIONS OF CHANCE 
OR GUESSING LEVEL SCORES ON SUB-TESTS OF THE STANFORD ACHIEVEMENT TEST. 



Sub-test 


Primary 1 


Primary II 


Internoediate 1 


Intermediate II 


Advanced 


Mean 


s.d. 


Mean 


s.d. 


Mean 


.d. 


Mean 


s.d. 


Mean 


s.d. 


Word Reading/ 
Word Mealing 


9 




9 


2.6 


9 


2.7 


12 


3.0 


« 


« 


Paragraph Meaning 


9 


2.7 


15 


3.4 


15 


3.4 


16 


3.5 


15 


3.4 


Vocabulary/Science 
8( Social Studies 
Concepts 


13 


2.9 


13 


2.9 


« 


« 


* 


« 




• 


Spelling 


* « 


« « ' 


« « 


« « 


13 


3.1 


14 


3.2 


15 


3.3 


Word Study Skills 


19 


3.5 


19 


3.6 


18 


3.6 


« 


« 


« 


* 


Language 


* 




28 


4.2 


46 


5.3 


49 


5.5 


51 


5.6 


Arithmetic Computation 






« « 


« « 


8 


2.5 


8 


2.5 


8 


2.6 


Arithmetic Concepts 










8 


2.4 


8 


2.4 


10 


2.7 


Arithmetic Applications 










7 


2.3 


8 


2.5 


7 


2.4 


Social Studies 










12 


3.0 


19 


3.7 


23 


4.2 


Science 










14 


3.2 


15 


3.3 


15 


3.4 



*Thii (ub-tett is not included in this battery. 
**Thi» tub-t«st is oot in multiple-choice format. 

ERIC 



in this study (i.e., !he mean number of correci dcvialionoflhedisuibulion of chance scores for each 
responses lo be expected by chunce), and also, in sub-test included in this study. Those sub-tests not 
accordance with Sax's (J%2) suggestion, the standard in multiple-choice formal were not included, 

TABLE 2: NUMBERS AND PfcRCENTAGES OF HEARINQ IMPAIRED STUDENTS RECEIVING SUB^ 
TESTS, OBTAINING GUESSING LEVEL SCORES, AND PROBABLY GUESSING. 

N,B.: Columns 1 thru 7 in Ibis table represent the following: 

® Number of students taking the sub«te$t 

(2) Number of students receiving guessing level scores 

S Number of students in the sample studied 
Number of students in the sample as a percent of the total number of students taking the sub-test and 
obtaining a chance score 

S Percent of total number of students receivmg guessing level scores 
Percent of total number of students who received guessing level scores for reasons other than guessing 
or random response 

Q) Percent of total number of students who were probably guessing or responding randomly 





CD 














Primary ! 
















Word Reading 


5793 


284 


57 


20.1% 


4.9% 


0.5% 


4.4% 


Paragraph Meaning 


5923 


499 


51 


10.2 


8.4 


1,0 


7.4 


Vocabulary 


5625 


2644 


51 


1.9 


47 0 


1.9 


45.1 


Word Study Skills 


1723 


231 


57 


24.7 


13/11 


5.9 


7.5 


■ iiiiiaiyit 
















«Yvi vj ivicaiMiiM 




ooo 


AQ 






9 90^ 


y.«}% 




I o 




R9 


9d 0 


O.D 


r» 9 






vQUO 


^UOo 


0 1 


9 R 


7 


A 7 


9A n 


WnrH ^tuHx/ ^kilk 
iv\^iu oiuvjy i7i\iit9 




HMO 


D 1 


1 1 


9ft R 


y.y 


in.o 


Language 


5800 


436 


51 


11,7 


7.5 


1.0 


6.5 


tntAriYiorliatD 1 
II 1 IVi MIcUluvc 1 
















\A/Arrt A/lpAninn 


9ft 1 7 






t 9 9<it 


iA 


o.y 






9ft1 7 


9T7 


A^ 


1 Q n 


ft A 


9 n 


D.*f 


^npilinn 
o|jd III iij 








09 f\ 


9 n 


n 9 


1 7 


Word ^tuH\/ ^kilk 
Tfi^fu i^iuuy ONIII9 


1 9^*^ 

1 £.00 


970 


Al 


\f\ ft 


99 9 




Ort 9 






oo 


CA 


01 1 

yo. 1 


9 1 


9 






Oft! 9 




OU 


y'l.o 


1 Q 

1 .y 


f* 7 


1 9 


ArifhrviPtip f^oYiPPrttc 

1 III I1 1 1 V 1 1 \« xyVyllvC^ld 


9ft 1 9 


^99 


Al 


1 •+,0 


1 1 

1 1 .0 


1 9 

1 .0 




Arithmetic Applications 


2810 


353 


45 


12.7 


12.6 


0.5 


12.1 


Social Studies 


2790 


54 


50 


92.6 


1.9 


0.2 


1.7 


Science 


2781 


66 


57 


86.4 


2.4 


0.3 


2.1 


Intermediate 11 
















Word Meaning 


1439 


274 


248 


90.5% 


19.0% 


3.6% 


15.4% 


Paragraph Meaning 


1436 


88 


70 


79.5 


6.1 


1.2 


'4.9 


Spelling 


1410 


26 


23 


88.G 


1.8 


0.3 


1.5 


Language 


1438 


24 


18 


75.0 


1,7 


0.2 


1.6 


Arithmetic Computation 


1437 


65 


58 


89.2 


4.5 


1,5 


3.0 


Arithmetic Concepts 


1437 


215 


189 


87.9 


15.0 


0.9 


14.1 


Arithmetic Applications 


1432 


107 


91 


85.0 


7.5 


1.0 


6.5 


Social Studies 


1428 


25 


22 


88.0 


1.8 


0.5 


1.3 


Science 


1421 


101 


86 


85.1 


7.1 


0.8 


6.3 


Advanced 
















Paragraph Meaning 


726 


56 


38 


67.9% 


7.7% 


1.0% 


6.7% 


Spelling 


715 


33 


21 


63.6 


4.6 


0.6 


4.0 


Language 


725 


10 


8 


80.0 


1.4 


0.2 


1.2 


Arithmetic Computation 


724 


32 


27 


84.4 


4.4 


2.1 


23 


Arithmetic Concepts 


720 


65 


50 


76.9 


9.0 


1.2 


7.8 


Arithmetic Applications 


716 


78 


53 


67.9 


10.9 


0.4 


10.5 


Social Studies 


715 


55 


39 


70.9 


7.7 


0.2 


7.5 


Science 


716 


23 


18 


78.3 


3.2 


0.7 


25 
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For sub-(es(s of the Advanced and Intermediate 
II baiteries, all individuals idenliried in (his manner 
constUuted the sample for this study. For sub-tests of 
the Primary I, Primary II, and Intermediate I batteries 
a sample of approximately 50 wns chosen for each 
sub-test separately by selecting every nih individual, 
n being determined for each sub-test so as to yield 
a sample of approximately 50. By this procedure a 
total of 2,365 cases of individuals having a low score 
on a given sub-test was identified. The original test 
^Atms for these 2,365 individuals were then located 
from storage files. Since not all the booklets were 
returned to this OfTice by the scoring center (the 
unreturned booklets long since having been 
destroyed), a total of 2.075 forms was actually 
located, for 87.74 percent of the total. These 2,075 
records provided tho data for this study. Columns 1-4 
of Table 2 list the number of students taking each 
sub-test of each battery in the national program, the 
number of low scores selected in the manner 
described above, the number of cases located and 
used in this study, and the number of cases located 
as a percentage of the number of low scores for the 
given sub-tests. Columns 5, 6. and 7 of Table 2 will 
be referred to later. 

Procedure 

Once the actual test forms were located, the fol- 
lowing procedures were employed. First, the number 
of items actually attempted by the given Student on 
the given sub-test was determined from the test form 
("attempted'' was defined as the presence of one or 
more marks in the answer spaces for the item in ques- 
tion). Second, of these attempted items the number 
which were correct was determined. Third, the per- 
cent of items answered correctly was calculated using 
the number of flems attempted as the base. Thus, on 
a60-item test» if 45 items were attempted and 15 were 
correct, the percent of correct responses was 33 per- 
cent. This procedure provides a measure of the likeli- 
hood of guesslng'by the given individual. Consider 
two students who both take the same 60-item multiple- 
choice test, in which each item has four possible 
responses. Each student obtains a raw score of 15 
items correct. Student A has attempted only 15 items 
and has answered all correctly. His percentage as 
determined above is 100 percent and it is extremely 
unlikely that this score was obtained solely by chance 
or random guessing. Student B, in contrast, has 
attempted all 60 items and answererd 15 correctly, 
interspersed throughout the test. His performance, 
with a rate of 25 percent correct answers, is indis- 
tinguishable from guessing or random response. 

I n any group of test-takers who guess completely 
at random, not all would obtain exactly 25 percent 
of the items correct, assuming items with four 
response choices. The guessing scores would be dis- 
tributed around that figure as a mean. I he standard 
deviations of these distributions of chance scores have 



been listed in Table 1. Conversion of these raw score 
standard deviations to percent correct scores shows 
that the resulting range of standard deviations in per- 
cent notation ranges from a low of four percent to 
a high of seven percent for various sub-tests. For the 
sake of simplicity, the figure of five percent was used 
as an estimate of Ihe standard deviation in every case. 
In determining whether the percent correct score for 
an individual did or did not suggest the likelihood of 
giiessing on the part of the student in question, this 
estimated standard deviation of five percent was 
added to the overall expected chance rate of success 
so as to consider as having guessed any individual 
whose percent correct score ranged up to one standard 
deviation above the m^an of chance scores. For exam- 
ple, if the expected percent correc- *^y chance for a 
given sub-test is 25 percent, this was increased by five 
percent to 30 percent. Any individual with a percent 
correct score up to and including 30 percent was then 
considered to have a performance indistinguishable 
from guessing or random response. This procedure 
should account for correct identification of 85 percent 
of all students whose performance was in fact based 
on guessing. About 15 percent of those who were actu- 
ally guessing or responding randomly would fail to be 
so labeled by this procedure, so that the resulting 
estimates of rate of guessing will tend to err slightly 
in a conservative direction. Gulliksen (1950) has sug- 
gested the use of a two standard deviation figure in 
situations similar to this, but the one standard devia- 
tion method used here appears sufficiently precise for 
the intended purpose. 

5^ESULTS 

The results from the samples studied are pre- 
sented in Tables 3-A through 3-M, according to the 
sub-test involved, across the five batteries. The first 
line of each table gives the average percent of items 
attempted by the low-score group. The second line 
of the table gives the average percent of items 
attempted which were answered correctly by this 
group of students. The third line of the table lists the 
percent of individuals in the sample studied who were 
probably guessing as determined by the ''mean + five 
percent** rule described above. 

Further implications of these results are pre- 
sented in columns 5 through 7 of Table 2. Column 
5 indicates the percent of the total number of students 
taking a given sub-test who obtained low raw scores 
at or below the theoretical chance level. Column 7 
indicates the percent of the total number of students 
taking a given sub-test who were probably guessing 
or whose performance is indistinguishable from ran- 
dom responding. The figures in column 7 were 
obtained by multiplying the percent given in column 5 
by the appropriate ^'percent guessing'" from Table 3, 
For example, for the Primary 1 Word Reading Sub- 
test, Table 3-A indicates that 89 percent of those with 
guessing level raw scores were probably guessing. 
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TABLE 3; MEAN PERCENT OF ITEMS ATTEMPTED, MEAN PERCENT OF ATTEMPTED ITEMS AN- 
SWFRED CORRECTLY. AND MEAN PERCENT OF GUESSING STUDY STUDENTS PROBABLY 
GUESSING, FOR SUB TESTS ACCORDING TO BATTERY LEVEL OF STANFORD ACHIEVE- 
MENT TEST. 




3- A: Word Re«dir.a/ 












Word Meaning Sub-test 












Mean Percent of hems Attempted 


89 


86 


76 


84 


• 


Mean Percent Correct of Herns Attempted 


19 


24 


24 


24 


• 








/D 


25 




Mean Percent of Low'score Studenti GuBssing 


89 


80 


r O 


O 1 




3^8: Speliirig Sub- test 












Mean f^ercent of Items Attempted 


• « 


4 « 




Dl 

o7 


on 
89 


Mean Percent Correct of Itenn* Attempted 




t t 


22 


25 


26 


Percent Correct To Be Expected 8v Chance 






25 


25 


25 




• • 


• • 


DQ 
OO 


<>*> 


86 
















• 




y 1 


72 


94 


Mean Percent Correct of Items Attempted 


• 


35 


37 


43 


34 


Percent Correct To Be Expected By Chance 


* 


37 


38 


37 


35 


Mean Percent of Low-score Students GuessinQ 




86 


93 


89 


88 


o— dOv'?' wiuo'cS Qup-iesi 












IVlCon rclCeiii UT iiBms MllcmpicO 






94 


86 


94 


Mean Percent Correct of Items Attempted 


• 


« 


74 


28 


22 


Percent Coirect To Be Exp<^cted Bv Chance 


• 




25 


25 


25 


Mean Percent of Low-score Students Guessing 






88 


72 


97 














inccid rciCVii ui llciliS rMlcrTipicCI 






OO 


93 


99 


Mean Percent Correct of Items Attempted 


• 


» 


22 


24 


23 


Percent Correct To Be Expected Bv Chance 


» 


• 


25 


26 


25 


MpAn Pc^rrpnt nff 1 nuu.cr'nrp QtiiHAnft r«taAcclnn 






88 


88 


78 


3'~F' Para^aph MeaninQ Sub-test 












Mean Percent oi f terns Attempted 


84 


90 


OO 


o/ 




Mean Percent Correct of Items Attempted 


22 


23 


25 


11 


24 


Percent Correct To Be Expected Bv Chance 


25 


25 


25 


25 


25 


Mfifin P<Mrrpnt nff 1 nxAi.cmrp ^turtpntt r«itaccin(t 

ivivail f CT\>Ctll \J% WWVV*>vVtC 0%UUVIi\> VJViv««Vil^| 


88 


AO 






o / 


3-Gr Word Study Skills Sub-test 












Mean Percent o^ Items Attempted 


57 


65 


93 


• 


• 


Mean Percent Correct of Items Attempted 


34 


32 


26 


• 


• 


Percent Correct To Be Expected By Chance 


33 


30 


30 






MfiJin PftrfPnt aI I nuu-cmfo ^fn/^nit r«itAic«r\n 


56 


59 


91 




• 


3~H: Arithmetic Computation Sub-test 












Mean Percent of Items Attempted 


• 


• • 


77 


70 


60 


M^an Percent Correct of Itenns Attempted 


• 


• • 


23 


21 


24 


Percent Correct To Be Expected By Chance 






20 


20 


20 


Mean Percent of Low^ore Students Guessing 




« • 


62 


06 


62 


3~K: Arithmetic Concepts Sub-test 












Mean Percent of Items Attempted 


• • 


• • 


94 


100 


84 


Mean Percent Correct of Items Attempted 


• « 


• • 


23 


22 


24 


Percent Correct To 8e Expected By Chance 


« • 


• • 


25 


25 


26 


Mean Percent of Low-score Students Guessing 


• • 


« • 


89 


94 


86 


3~L: Arithmetic Applications Sub-test 












Mean Percent of Items Attempted 


• 


» 


97 


96 


90 


Mean Percent Correct of Items Attempted 


• 


• 


19 


17 


17 


Percent Correct To Be Expected By Chance 


• 


• 


20 


20 


20 


Mean Percent of Low-score Students Guessing 


• 


• 


96 


87 


96 


3-M: Vocabulary /Science & Social Studies Sub-test 












Mean Percent of Items Attempted 


95 


100 


• 


• 


• 


Mean Percent Correct of Items Attempted 


30 


28 


ft 


• 


• 


l*ercent Correct To Be Expected By Chance 


33 


33 


• 




• 


Mean Percent of Low-score Students Guessing 


96 


98 


• 


• 


* 



■ This sub test is not included in this battery. 
••This sub-test is not in multipfe-choice format. 
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Multiplying this by the lltiuro in column 5 (4.9 per* 
cent), yields the figure reported In column 7. namely 
4.4 percent. Column 6 gives the difference between 
the figures in columns 5 and 7. The column 6 figures 
represent the percent of the iot;il nun^ber of students 
taking the given sub-test who obtained guessing level 
raw scores for reasons other than guessing or random 
response. While these reasons cannot be known in any 
definitive sense, the major reasons probably involve 
expiration of lime limits, avoidance of items which 
appear too difficult lo the test-laker, or withholding 
response because of doubt as to the correct answer. 

Prom the perspective of the main question posed 
in this study, column 7 contains the most significant 
data. The percentages in this column represent the 
percentage of students who — on the basis of the 
assumptions which lie behind this study — obtained 
loo high a score on the basis of guessing. 

DISCUSSION 

Kxnmination of the results indicates, first, that 
fewer than 10 percent of the students tested were prob- 
ably guessing on 26 of the 36 sub-tests studied: and, 
second, guessing level raw scores were apparently the 
result of guessing in the overwhelming majority of 
cases, with the exception of Word Study Skills at the 
Primary levels and Arithmetic Computation at the 
Intermediate and Advanced levels, in which cases 
only about one-half to two-thirds of the low scores 
were related to guessing. Guessing is a serious prob- 
lem on only four sub-tests: Primary 11 Word Study 
Skills, Intermediate I Word Study Skills. Primary II 
Science and Social Studies Concepts, and Primary \ 
Vixabulary, The first two of these are inappropriate 
for testing hearing impaired children because of the 
very nature of the items, which require comparisons 
uf sounds, etc. The Annual Survey recommended that 
these sub-tests not be used, and the data given here 
are based on those programs which did use these tests 
despite the recommendation. The other two sub-tests 
were revised to Form W-HI for the 1970-71 testing 
program i^y printing into the student's test booklet the 
text of items which are dictated in the original version 
of the test. While this apparently assists some stu- 



dents, it has the drawback of being written language 
which is ubove the average reading level of the hearing 
impaired student. These items, dictated by the 
teacher, are appropriately comprehensible to hearing 
students. In written form, the language is beyond that 
of hearing impaired students taking the given battery 
and very possibly beyond that of the hearing students 
in the standardization sample as well. This may very 
well be a major factor underlying the high proportions 
of guessing in these two sub-tests. 

With the exceptions noted above, then, guessing 
does not appear lo be a major problem in the National 
Achievement Testing Program conducted in 1970-71. 
The question of guessing is very largely related lo the 
issue of testing at appropriate levels of diftlculiy and 
content coverage; the likelihood of guessing increases 
substantially if the student is tested with a battery 
which is beyond his present range of academic ability. 
The present results were obtained on a national basis 
in a program in which the assignment of testing bat- 
teries to students, was based on a careful screening 
test procedure which has been described elsewhere.^ 
They represent a significant improvement over the 
first National Achievement Testing Program con- 
ducted by the OfTice of Demographic Studies in 1%9, 
In that earlier program the screening lest procedure 
was not used, and the proportions of scores in the 
guessing range were significantly higher. 

Since ihe purpose of norm-referenced lesls such 
as the Stanford Achievement Test is lo differentiate 
among achievement levels in a group of students, since 
the extent of guessing as determined by this study is 
not of major proportions, and since the available data 
(e.g., Jackson, 1955) indicate that scores corrected for 
guessing have a high positive correlation with uncor- 
rected scores based ijunply on ihe number of correct 
answers, it is concluded thai the usefulness of the 
Stanford Achievement Test with hearing impaired stu- 
dents is not significantly impaired by the factor of 
guessing on the part of the test-taking students. 

'See Aatiicmk AchU'vemctit Test Rv suits of a Sat'onat 
Testing Program for Hearing! Impaired Students, United 
States: Spring 197 L Gallaudet College, Office of Demo- 
graphic Studies, Series D, Number 9. 
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Intercorrelatlons Among the Sub-Tests of 
the Stanford Achievement Test, 
Hearing Impaired Students: United States, Spring 1971 

Raymond J. Trybus 



INTRODUCTION 

One of the (echnical considerations in the design 
of an achievement test is (he extent to which the Vciri- 
ous sub-tests which make up a teM battery are cor- 
refaled with each other. While there are no hard and 
fast rules, it is generaJly desirable thai such sub-test 
intercorrelatlons be low and positive. When this is the 
case. Ihe correlations constitute evidence that the vari- 
ous sub-tests are in fact measuring different areas of 
knowledge which are more or less independent. High 
positive inlercorrcJations. on the other hand, do not 
necessarily negate the value of the correlated 
measures* since all human performances tend to have 
some positive iniercorrelation aiid since other consid- 
erations of curriculum coverage and Ihe logical divi- 
sions of academic subject matter enter into test design 
as well. Nevertheless, low correlation figures lend 
added weight to chums regarding the distinctness or 
independence of various subject matter fields. 

This study examines the intercorrclations among 
all the sub-tesls of all five batteries of the Stanford 
Achievement Test used in the Spring 1971 National 
Tcstmg Program conducted by the Office of Demo- 
, graphic Studies and involving special educational pro- 
grams serving hearing impaired students. The data are 
presented in three sections: first, the figures for hear- 
ing impaired studcnls, regardless of age. are presented 
along with the comparable figures fur the standardiza- 
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tion group;^ second, (he figures for the hearing 
impaired students are presented according to the age 
of the students; finally^ the average intercorrelations 
of each sub-test with other sub-tests in the same bat- 
tery are examined, with a view to the selection of a 
screening test required for testing hearing impaired 
students. These data are subject to the same cautions 
and limitations which apply to all data derived from 
the 1971 testing program. Appendix II describes these 
limitations in detail. The intercorrelations reported for 
the hearing standardization sample were obtained 
from the Technical SuppJement for the Stanford tests* 
and are based on results obtained with Form X of 
the tests. As such» they are not directly comparable 
to the correlations reported here for Form W. but (he 
similarity of content, formal, and psychometric 
characteristics of ihe two forms suggests thai the dif- 
ferences between them in intercorrelation coeftlcienis 
would be very small; and ihe reported figures are 
therefore useful for general comparisons such as those 
intended here. 



'The term "standardiziitiotT group" used throughout this 
paper refers to the ricitionul sample of normally hearing stu- 
dents on whom the normative data for the Stanford test arc 
based. 

^Kclley. T.l... Madden. R,, Gardner, E. F., and Rudman, 
H. C. Stdnforti Ai hicwmcnt Test Tcchnual Suppfvment, 
New York: Harcourt. Brace & World, inc., 1966. pf\ 1618. 
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TABLE 1; MEAN AND MEDIAN INTEftCORRELATIONS FOR THE FIVE BATTERIES OF THE STANFORD 
ACHIEVEMENT TEST FOR HEARING IMPAIRED AND STANDARDIZATION GROUP STU- 
DENTS: UNITED STATES, SPRING 1971. 



Battery 


Hearing 


Impaired 


SUndardiiatlon Group 


Meao 


Median 


Mean 


Median 


rrimary 1 


.46 


.46 


.63 


.63 


Primary M** 


.45 


.48 


.66 


.67 


intermediate I*** 


.50 


.60 


.69 


.70 


Intermediate (("** 


.63 


.63 


.70 


.71 


Advanced""* 


.61 


.62 


.68 


.69 



•Stdndardization Group figures are based on Grade 1 students. 
* ^$Uf)(h^f^i2Qiion Group figures ere bned on Grade 3 students. 
***$tBn<iardinition Group fiQures are based on Grade 4 $tu6e/M$, 
••**Stanciafdization Group figures sre based on Grade 6 students. 
• * • •Standardization Group figures are based on Grade 9 students. 



TABLE 2: INTERCORRELATION MATRIX FOR THE PRIMARY I BATTERY, STANFORD ACHIEVE- 
MENT TEST, FOR HEARING IMPAIRED AND STANDARDIZATION GROUP STUDENTS, 



Test 


Arithmetic 


Word Study 
Skills 


Spelling 


Vocabulary 


Pdrasraph 
Meaning 


Word Meaning 


.58* 


.44 
J3 


,65 
.73 


.28 
.55 


.78 
.72 


Paragraph Meaning 


.68 
.60 


.46 
.67 


.59 
.71 


.30 
.50 




Vocabulary 


.34 
.63 


.23 
,S) 


.25 
.49 






Spelling 


.46 
,59 


.50 
.72 








Word Study Skills 


.44 

.66 











•In each case the upper figure is that for the hearing inr>paired group (N ^^5900). 

••In each case the lower figure is that for the standardization group (N ^1000), These figures are reproduced from Stanford 
Achlevenient Test, copyright C 1964-6$ by Harcourt Brace Jovanovich. Inc. Reproduced by permisiion. 




INTERCORREIATIONS FOR 
THE HEARING IMPAIRED AND 
THE STANDARDIZATION GROUPS 

Table \ rcpiirls ihc mean and median inlercorrela- 
lions for Ihe five baiieries lor both ihe hearing 
impaired and ihc slandardizalion groups. Tables 2 
through 6 report ihc iniercorreiaiionji for all ihe i>ub- 
lesls of all batteries, for boih the hearing impaired and 
the standardization groups. 

From inspection of these tables it is apparent thai 
the correlations are generally lower for Ihe hearing 
impaired group. The overall average correlation for 
Ihe hearing impaired group (unweighted) is .51; ihe 
corresponding figure for Ihe standardization group is 



.67. The evidence* then, suggests lhat the various 
academic lasks of reading, figuring, etc., are some- 
what more independent forms of knowledge among 
the hearing inipar J students than is the case among 
the standardization group students. The data in Ta- 
ble I also indicate a trend for the average iniercorrela- 
lion to increase from the lower to the upper batteries 
for hearing impaired students. A similar trend exists 
in the slaiidardizaiion group data, but to a lesser 
degree. Expressed another way, this suggests that 
knowledges which tend to be separate and independ- 
ent in ihe earlier years of academic training begin 
to become more integrated as the individual pro- 
gresses academically. 



TABLES: INTERCORRELATION MATRIX FOR THE PRIMARY II BATTERY, STANFORD ACHIEVE- 
MENT TEST, FOR HEARING IMPAIRED AND STANDARDIZATION GROUP STUDENTS. 



Test 



Arithmetic Arithmetic Word Study Science & Paragraph 

Concepts Computation Language Skills Spelling Social Studies Meaning 



Word 
Meaning 



.52' 
.70** 



.39 
.53 



,54 
,74 



,36 
.69 



.50 
,72 



,51 

.66 



.67 
.83 



Paragraph 
Meaning 



,60 
.73 



.48 
.57 



.65 
.78 



,38 
.73 



,53 
.76 



.48 

,62 



Science & Social .49 
Studies Concepts .64 



.36 
.46 



.44 
.57 



.23 
.54 



.33 
.46 



Speiting 



.38 
,63 



.38 
.64 



.71 



.21 
.69 



Word Study 
Skills 



.35 
.68 



.18 

.53 



.27 
.70 



Language 



.60 
.70 



.52 
.56 



.^,>^^^^\pnelic .67 
Computation .67 



•fn each case the upper figure i$ ihal for the hearing irroaired group {N ^5900). 
**ln each case the lower figure is that for the sidodardizaiion group (N ^^1000). These figurei are reproduced from Stanford 
:hifivemenl Test, copyright 0 1964-66 by Harcourt Brace Jovanovich, lr>c. Reproduoed by permission. 
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TABLE 4: INTERCORRELATION MATRIX i-'OR THE INTERMEDIATE I BATTERY, STANFORD 
ACHIEVEMENT TEST, FOR HEARING IMPAIRED AND STANDARDIZATION GROUP STU- 
DENTS. 



Ttst 


Social 




Arithmetic 


Arithmetic 


Arithmetic 




WordSludy 




Paragfaph 


StudiBi 




Appliettioni Conc«pti 


Compulation 


Langues* 


Skills 


Spelling 


Mining 


Word 


.49' 


.54 


.44 


.42 


.28 


.54 


,37 


.52 


.62 




78'* 


73 


.63 


.61 




7R 
. / o 


71 






Paragraph 


.61 


.63 


.55 


,49 


.32 


.61 


.42 


.53 




M^aninQ 


.82 


.77 


.70 


.67 


.57 


.79 


.73 


,74 




Spelling 


.51 


.49 


.46 


.44 


.45 


.66 


.34 








.68 


.64 


.60 


.55 


.53 


.76 


.74 






Word Study 


.33 


.38 


.36 


.33 


.18 










Skills 


72 


.80 


.65 


.64 


.59 


.80 








Language 


.61 


.68 


.60 


.56 


.46 












.76 


.72 


.70 


.69 


.64 











Arithmetic 


.49 


.32 


,62 


.64 


Computation 


,57 


.55 


,66 


.63 


Arithmetic 


.66 


.50 


.77 




Concepts 


.64 


.70 


.74 





Arithmetic .69 .58 
Applications .71 .72 

Science .67 
.80 



•|n each case the upper figure is that for the hearing impaired group (N ^2800). 

each case the lowver figure is that for the standardization group (N ^sslOOO). These figures are reproduced from Stanford 
Achievement Test, copyright 0 1964-66 by Harcourt Brace Jovanovich, Inc. Reproduced by p>ermission. 
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TABLES: INTERCORRELATION MATRIX FOR THE INTERMEDIATE II BATTERY. STANFORD 
ACHIEVEMENT TEST. FOR HEARING IMPAIRED AND STANDARDIZATION GROUP STU^ 
DENTS. 



Social Arithmetic Arithmetic Arithmetic Paragraph 

Test Studies Science Applications Concepts Computation Language Spelling Meaning 







53 


.HO 


17 
.0/ 


9fi 


.00 


.00 


Meaning 




.77 


.70 


.69 


.55 


.76 


.70 


r di cJy 1 opi 1 




70 






Oft 


.00 ^ 




Meaning 


.80 


.81 


.74 


.72 


.61 


.80 


.70 


^r\pt iinn 




41 






.ID 


.00 






.53 


.58 


,60 


.56 


.59 


.76 




Language 


■DU 




.00 


.01 










.70 


.77 


.74 


.73 


.68 






Arithmetic 


.50 


.26 


.69 


.67 








Computation 


.52 


.59 


.70 


.68 








Arithmetic 


.56 


.41 


.76 










Concepts 


.77 


.69 


.84 










Arithmetic 


.68 


.53 












Applications 


.72 


.79 












Science 


.66 
















.80 















*ln each case the upper figure ii that for the hearing impaired group (N ^MOO). 
•*ln each case the lower figure is that for the siandardtzation group (N ssjIOOO). These figures are reproduced from Stanford 
Achievement Test, copyright C> 1964-66 by Harcourt Brace Jovanovich, Inc. Reproduced by permission. 
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TABLE 6: INTGRCORRELATION MATRIX FOR THE ADVANCED BATTERY, STANFORD ACHIEVE- 
MENT TEST, FOR HEARING IMPAIRED AND STANDARDIZATION GROUP STUDENTS. 



1 OSi 


Social 
ocviiiies 


Oi^ 1 Ji r«l%A 


Arithmetic 
AppticauOfis 


Arithmetic 
Concepts 


Arithmetic 
L>ompuvai(On 


LanfiMage 


opening 


Paragraph 
ivi^dfiinQ 


.80* 

. // 


.72 

OA 


.58 


.56 


.39 

.Del 


.73 

./O 


.60 


Spelling 


.63 


.40 


.48 


.57 


.53 

•DO 


.75 

7A 




Language 


.76 

•Do 


.63 


.61 

.OD 


.66 

,7*1 


.59 

7A 

• 74 






Arithn>etic 
v/Ompuiaiion 


.47 

.00 


.40 

■oo 


.61 
.70 


.75 








Afithmetic 
Concepts 


.67 
.67 


.60 
.76 


.75 
,75 










Arithmetic 
Applications 


.71 
.65 


.61 
.71 












Science 


.77 

.80 















•Jn each case the upper figure is that for the hearing impaired group (N ;?5;725), 
••In each case the lower figure is that for the standardization group (N sslOOO). These figures are reproduced frorT> Stanford 
Achievement Test, copyright O 1964-66 bv Harcourt Brace Jovanovich, Inc. Reproduced by permission. 



TABLE 7: AGE RANGES IN.YEARS* AND NUMBERS OF STUDENTS** FOR THE INTERCORRELATION 
MATRICES FOR HEARING IMPAI RED STUDENTS, BY AGE GROUP. 





Age Group 1 


Age Group 2 


Age Group 3 


Age Group 4 






Age 




Age 




Age 




Age 


Battery 


N 


Range 


N 


Range 


N 


Range 


N 


Range 


Prinr^ary 1 


1352 


8 & Under 


1485 


9-10 


1670 


1M2 


1411 


13^^ 


Primary II 


1551 


11 & Under 


1848 


12-13 


1658 


14-16 


860 


17+ 


Intermediate 1 


654 


13 & Under 


801 


1415 


730 


16-17 


631 


18+ 


Intermediate II 


306 


14 & Under 


425 


15^16 


486 


1718 


221 


19+ 


Advanced 


134 


15 & Under 


287 

i 


16-17 


173 


18 


131 


19+ 



•All ages were computed as of December 31, 1970. The four age groups were selected so as to minimi?e the variation In 
size of the groups, while rr^intaining whole-year age groups (i.e., age groups bounded by fractional ages were not used). 
••The N'$ reported here are maximum possible N's; I.e., the reported N is the greatest N observed for any correlation in the 
matrix for the given battery. The N's for sonr>e of the correlations are lower than this maximum due to incomplete test batteries, 
absence of some students on one or another day of testing, etc, 

o 
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INTERCORRELATIONS FOR 

THE HEARIKC IMPAIREO GROUPS^ 

BY AGE 

In order to detcinune the inftuence of the age of 
hearing impaired students on the intercorrelaiions 
observed anumg their sub test scores, the ^roup of 
students receivini; each of the five balteiy levels uas 
divided into four age groups in such a way as to 
minimize the variation of numbers of students 
assigned to each of the four groups. All ages were 
computed as of December 31, 1970, and only whole- 
year ages were considered in group assignment. Ta- 
ble 7 presents the age ranges in years for each of the 
four age groups for each of the five battery levels, 
along with the number of students falling into each 
category. 

Ihe intercorreJations obtained for the four age 
groups for e.ich of the five battery levels are presented 
in Tables 8 through 12, In each cell of the table, the 
top figure is for the youngest age group, the second 
figure for the neM oldest group, and so on to the figure 
for the oldest age group at Ihe bottom of the cell. 

lv\aniination of these tables indicates the pres- 



ence of some age trends for hearing impaired students, 
but these trends are complex and do not hold in every 
individual case. Overall, for Ihe Pri*iKiry I battery the 
trend is lo lower correlations as age increases. Twelve 
out of fifteen correlations decreased across age 
groups, with an average decrease of ,09. For the Pri* 
mary ][ battery. 21 out of 28 correlations show a 
decrease across age groups, with the average decrease 
being .06. In the Intermediate I battery 22 out of 45 
correlations show a decrease, and the resuhing mean 
change shows a decrease of less than .01 as age 
increases. In the Intermediate II battery, 26 out of 
36 correlations decrease across age, with a mean 
change of .04. In the Advanced battery the situation 
is reversed, with 24 out of 28 correlations showing 
an increase as age increases, with a mean increase 
of .06 from the youngest to the oldest group. 

While the aviiilable figures for the hearing stan- 
dardization group iue based on different age groups, 
the pattern seems to be one of increasing correlations 
as age increases. For the Primary II standardization 
group the mean correlation rises from .58 to .65 be- 
tween Grade 2 and Grade 3. For the Intermediate II 
battery the rise is from .66 to .70 between G;ade 2 



TABLE 8: INTERCORRELATION MATRIX FOR THb PRIMARY I BATTERY, STANFORD ACHIEVE- 
MENT TEST, FOR HEARING IMPAIREO STUDENTS, BY AGE GROUP. 



Test 




Word Study 






Paragraph 


Arithmetic 


Skills 


Spelling 


Vocabulary 


Meaning 


Word Meaning 


.58* 


.57 


.68 


.27 


.79 






.46 


.66 


.21 


.77 




.46* 


.46 


.59 


.23 


.75 




.51* 


.27 


.56 


.34 


.77 


Paragraph Meaning 


.59 


.54 


.65 


.29 






.53 


.47 


.61 


.24 






.54 


.51 


.54 


.26 






.55 


.28 


.48 


.36 




Vocabulary 


.34 


.27 


.24 








.34 


.31 


.27 








.34 


.23 


.20 








.32 


.11 


.28 






Spelling 


.47 


.53 










.46 


.54 










.42 


.50 










.34 


.41 









Word Study Skills .50 

.48 
.43 
.34 



*ln each cell of this table, the topmost correlation figure is that for the 8 year old and under group; the second is for the 9 10 
vca^ oki gcoup; the ihird is lor the I M? year ofd group; and the bottom rnost (igure is for students t3 years old and up. 
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TAB .EO: INTERCORRELATtON MATRIX FOR THE PRIMARY II BATTERY, STANFORD ACHIEVE- 
MENT TEST, FOR HEARING IMPAIRED STUDENTS, 8Y AGE GROUP. 



Science & 





Arithmetic 


Arithmetic 




Word Study 




Social 


Paragrapl 


T#st 


Concepts 


Computttiofi 


1 jinaudofi 


Skills 






Mftanlna 

I* IWI III l\a 


Word 


,55* 


.39 


.52 


.43 




4R 


. 


Meaning 


,61* 


.40 


.54 


.34 


,53 


.50 


.68 




.60* 


.38 


.55 


.35 


,47 


,50 


.67 




SO* 


as 










.OO 


Paragraph 


.63 


48 


.65 


45 




• HO 




Meaning 


.59 


.51 


.66 


.39 


.56 


,48 






.59 


.47 


.65 


.33 


.46 


.49 






.57 


.43 


.64 


.33 


45 


.53 




Science & Social 


.46 


•.31 


.34 


*30 


32 






Studies 


,47 


.32 


.43 


.26 


.36 








.48 


.33 


,46 


.24 


.24 








.47 


.26 


.45 


.23 


26 






SDellina 


.45 


.42 


.57 


.34 










.39 


.36 


.59 


.25 










.26 


.27 


.42 


.15 










.24 


.13 


.44 


.26 








Word Study 


.45 


.29 


.40 










Skills 


.36 


.28 


.29 












.38 


.25 


.30 












.35 


.22 


.23 










LanQuaoe 


.58 


.49 














. w 


.51 














.60 


^49 














.59 


.49 












Arithmetic 


.66 














Computation 


.67 
















.66 
















.64 















• I n each eel I of this table, the topmost correlatio.n figure i$ that for the 1 1 year old and under group; the second is for the 1213 
year old group; the third is for the 14-16 year old group; and the bottom most figure is for students 1 7 years old and up. 
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TABLE 10: INTERCORRELATION MATRIX FOR THE INTERMEDIATE I BATTERY, STANFORD 
ACHIEVEMENT TEST, FOR HEARING IMPAIRED STUDENTS, BY AGE GROUP. 



Ttit 


ll 


S<iar)€« 


Anthmatic Arithmttlc 
Applieationt Concepti 


Afithmatlc 


1 AnauAM 


Word Study 

Skill* 




Ptrtgrtp 


Word Meaning 


47' 


.52 


AO 
.HZ 




.21 


.52 


.40 


.49 


.64 




.46' 


.53 


.43 


.41 


.27 


.53 


.37 


.48 


.61 




.54* 


.57 


.48 


.46 






.1 1 




.04 




.47' 


,62 


.43 


.42 


.31 


,54 


.39 


.54 


.60 


Paragraph 


.Oo 


.66 


.59 


.53 


.30 


.61 


.50 


.55 




Meaning 


.62 


.64 


.55 


.46 


.35 


.61 


.42 


.52 






.60 




.53 


.48 


.32 


.61 


.40 


.53 






.69 


.63 


,56 


.52 


.39 


.62 


.39 


.56 




Spelling 




.58 


.48 


.46 


.44 


.69 


.43 








47 


,47 


.46 


.43 


.41 


.63 


.37 








,49 




.40 


.39 


.40 


.66 


,36 








.50 


,49 


.46 


.41 


.47 


.64 


.45 






Word Study 


.39 


.46 


.39 


.39 


.23 


.55 








Skills 


.44 


.41 


.45 


.39 


.33 


.49 










.31 


.36 


.40 


.36 


.31 


.42 










,31 


.32 


.39 


.37 


.20 


.44 








Language 


.62 


.63 


.59 


.57 


.41 












.61 


.67 


.61 


.54 


.47 












,62 


.57 


.60 


.57 


.50 












.58 


,56 


.56 


.52 


.47 











Arithmetic 


.49 


.33 


.55 


.58 


Computation 


.43 


.30 


.62 


.64 




.49 


.38 


.62 


.64 




.64 


.37 


.64 


.64 



Arithmetic 


.64 


.52 


.74 


Concepts 


.62 


.48 


.77 




.66 


.52 


.75 




.70 


.53 


.78 



Arithmetic .70 .59 

Applications .67 .59 

.69 .60 

.70 .58 



Science ,67 
.67 
.69 
.67 



"In each cpM of this table, the toprT>ost correlation figure is that for the 13 year ofd and under group; the second is for the 14-15 
year old group; the third is for the 16-17 year old group; and the bottom-most figure is for students 18 years old and up 
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TABU: 11: INTERCORRELATION MATRIX FOR THE INTERMEDIATE, II BATTERY, STANFORD 
ACHIEVEMENT TEST, FOR HEARING IMPAIRED STUDENTS, BY AGE GROUP. 

Social Arithmetic Arithmetic Arithmetic P«raoraph 

Test Studies Sdenc« Application! Concepu Computation Language Spelling Meaning 



Word Meaning 


.57* 


.68 


.46 


.42 


,26 


60 


57 




.51* 


.68 


.45 


.39 


^22 


.55 


.54 




.68* 


.59 


.47 


.37 


.34 


.57 


.61 




.46' 


.55 


.39 


.31 


.28 


.60 


.59 


Parao^'dph 


.61 


.73 


.52 


43 






.00 


Meaning 


.61 


.69 


.50 


.39 


,25 


.55 


.48 




.66 


.69 


.58 


.47 


.37 


-.56 


.51 




.59 


.63 


.49 


.38 


.37 


.56 


.56 


Spotting 


.58 


.49 


.53 






71 






.45 


.40 


.40 


.35 


.36 


.65 






.53 


.43 


.46 


.37 


.47 


.71 






.48 


.39 


.46 


.35 


.43 


.61 




LanQuao6 


.66 


.58 


.56 












.56 


.49 


.63 


.50 


.45 








.59 


.54 


.66 


.51 


.57 








.55 


.54 


.62 


.58 


.59 






Arithmetic 


.50 


.31 


71 










Computation 


.43 


.24 


.64 


.63 










.54 


.35 


.70 


.69 










,48 


.28 


.71 


.75 








Arithmetic 


.55 


.43 


.73 










Concepts 


.56 


.43 


.75 












.55 


.45 


.76 












.54 


.35 


.78 










Arithmetic 


.68 


.55 












Applications 


.69 


.54 














.69 


.57 














.62 


.45 












Science 


.70 
















.65 
















.69 
















.59 















•In each cell of this table, the topmost correlation figure is that for the 14 year old and under group; the second is fof the 15-16 
year old group; the third is for tUi 1718 year old group; and the bottom-most figure is for students 19 years old and up. 
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TABLE 12: 



INTEncORRELATION MATRIX FOR THE ADVANCED BATTERY, STANFORD ACHIEVF- 
MENT TEST, FOR HEARING IMPAIRED STUDENTS, BY AGE GROUP. 









Arithmetic 


Mriinmetic 


Arithmetic 






Tejt 


Studies 


Science 


Applications 


Concepts 


Computation 


Language 


Spelling 


Paragraph 


.76* 


.73 


.58 


.62 


.47 


.76 


.66 


Meaning 


.79- 


.73 


.67 


.55 


.35 


,71 


.60 






.DO 


.09 


,07 


.40 


.71 


.52 




82* 


.72 


.63 


,58 


.51 


.77 


.69 


Spelling 


.64 


.49 


.46 


53 


.54 


.78 






.66 


.54 


.51 


.57 


.48 


.77 






CIA 


.Jo 


.40 


.54 


.52 


.70 






.74 


,61 


.55 


,66 


.60 


.76 




Language 


.73 


.62 


.52 


.63 


.58 








.76 


.65 


.62 


.68 


.59 








79 


.0/ 






.56 








.81 


,69 


.71 


.71 


.69 






Arithmetic 


.52 


.42 


.62 


.72 








Computation 


.49 


.42 


.61 


.75 














etf\ 
.DU 


. /4 










.56 


.51 


.67 


.81 








Arithmetic 


.69 


,61 


.77 










Concepts 


.69 


.65 


.74 












.62 


.51 


.75' 












,70 


.62 


.77 










Afiihmeiic 


.71 


.63 












Applications 


,72 


.63 














.64 


.55 














.76 


.66 













Science .77 
.78 
.72 
,80 



• In each cell of thti table, the topmost correlation figure is that for the 1 5 year old and under group; the second is for the 16-17 
year old group, the Ihkfd is for the 18 year old group; and the botlom-mosi figure is for studenls aged 19 years old and up. 



and Grade 3. Por the Inlermediaie II ballery ihc 
rise is from .66 lo ,70 between Crrade 5 and Grade 
6. The figures for (he Advanced battery are somewhat 
less clear-cul, with mean correlations of .66. ,69. and 
.68 for Grades 7. 8. and 9 respectively. The trends, 
in any case, seem gene rail) to be in opposite directions 
for the hearing impaired and the standardization 
groups. 

These results, both those for the age groups and 
those for the hearing \m^m^^ versus the slandardi/a- 
lion group, suggest the p<.>ssibility of different factor 
structures for the hearing impaired group as compared 
with the standardization group and of different trends 
in change of factor structure across age for the two 



groups. These factor analyses have not yet been done, 
but might prove lo be very instructive in the investiga- 
tion of the organization of academic abilities in the 
hearing impaired student population as compared with 
the general hearing population. 

AVERAGE tNTERCORRELATtON OF 
A SUB-TEST WITH ALL OTHER 
SUB-TESTS IN THE BATTERY 

A final issue of concern w ith respect lo the inter- 
correlations is the question of which sub-tests have 
the highest average intercorrelations with all the other 
sub-tests in the battery. This has practical implications 
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for testing of hearing impaired students as one basis 
for setection of a screening device.' A sub-test which 
has a high average intercorrelation with all other sub- 
tests in the battery will be a better predictor of overall 
performance than another sub-test which has a lower 
average intercorrelation, and therefore will be more 
appropriate as a screening test. Table 13 lists the aver- 
age intercorrelations for all sub*lests of the five bat* 
tcries employed in the 1971 testing program. For com- 
parison purposes the average intercorrelations are 



*For a review of the screening procedures and their 
rationale, see Ofllce of Demographic Studies publications 
Series D, Number 9, Academic Achitvement Test Results 
of a National Testing Program for Hearing Impaired Stu- 
dents, United States: Spring i97l and Series D, Number 
lU Studies in Achievement Testing, Hearing impaired Slu* 
dents, United States: Spring 1971. 



reported both for the hearing impaired group and for 
the standardization group, 

Exajnination of these tables shows that for the 
Primary I level» Paragraph Meaning has the highest 
average correlation; for Primary 11, it is second by 
one point (i.e., .54 as compared with ,55 for the Word 
Meaning Sub-test). For the three upper tevelsi Para- 
graph Meaning ranks fourth, after Social Studies, Lan- 
guage, and Arithmetic Applications, although the dif* 
ferences among the average intercorrelations for these 
four sub-tests are small at the upper levels. 

in relating these findings to the problem of select* 
ing a particular sub-test to serve as the screening 
instrument* two considerations are relevant. First, it 
seems desirable to maintain the greatest possible sim- 
plicity in the procedures for achievement testing* since 
a large number of factors already enter into the use 



TABLE 13: AVERAGE INTERCORRELATIONS OF THE SUB TESTS WITH ALL OTHER SUB-TESTS IN 
THE SAME BATTERY, HEARING IMPAIRED STUDENTS AND STANDARDIZATION GROUP 
STUDENTS, SPRING 1971, 





Primary 1 


Primary II 


Intermediate 1 


Intermediate II 


Advanced 


6ub-tett 


SG* 


Hl*» 


SG 


HI 


SG 


HI 


SG 


HI 


SG 


HI 


Word Meaning 


.67 


.55 


.70 


,50 


.69 


.47 


,72 


.50 






Paragraph 
Meaning 


.64 


.54 


.72 


.54 


.73 


,53 


.75 


.52 


,73 


.63 


Vocabulary 


.56 


.28 


















Science & Social 
Studies Concepts 






.56 


.41 














Spelling 


.65 


.49 


.64 


.41 


.66 


,49 


.63 


.50 


.54 


.58 


Word Study 
Skills 


.68 


.41 


.65 


.28 


.71 


.35 










Language 






.68 


.51 


.73 


,56 


.74 


.56 


.72 


.68 


Arithmetic 
Computation 






.55 


.43 


.58 


.42 


.62 


.45 


.68 


.53 


Arithmetic 
Concepts 


.62 


.48 


.68 


.52 


.65 


.53 


.71 


.51 


.71 


.65 


Arithmetic 
Applications 










.68 


.56 


.73 


.58 


.66 


.62 


Science 










.71 


.52 


.73 


.52 


.73 


.60 


Social 
Studies 










.72 


.56 


.70 


.58 


.64 


.69 



'SG = Standardfistion Group 
* •HI=Heafing Impaired Group 
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of such tests with hearing impiured students. On this 
basis» it would be more appropriate to use the Para- 
graph Meaning Sub-test as the screening test at alt 
levels simply for the sake of uniformity and simplicity. 
The second consideration reinforces the first and 
inyplves the fact that for this 1971 testing program 
over 70 percent of all students tested were tested al 
the two primary levels. With these considerations in 
mind, the choice of the Paragraph Meaning Sub-test 
as the screening instrument for this testing program 
and for future testing purposes seems to be an appro- 
priate one. 

SUMMARY 

This study has examined the Inlercorrelations 
among the sub-tests of the Stanford Achievement Test 



for hearing impaired students. By comparison with the 
hearing standardization group, the correlations for the 
hearing impaired group tend to be lower in most 
instances. When considered across age gioups» the 
correlations for the hearing impaired students tend to 
decrease as age increases, except for the Advanced 
battery in which ihc correlations increase with age. 
This is different from the standardization group* in 
which the general tendency is for correlations to 
increase with age at all test levels. Finally, considera- 
tion of the average intercorrelations of each sub-test 
with all other sub-tests in the same battery suggests 
that the Paragraph Meaning Sub-test is the best single 
sub-test to use as a screening device for assigning the 
most appropriate battery with which to test a hearing 
impaired student. 
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Results of a Survey on the Use of 
Achievement Tests in Educationai Programs 
For Hearing Impaired Students: 
United States, 1972-73 

Carol Buchanan 



INTRODUCTION 

In 1968 ihe attention of the Annual Survey of 
Hearing Impaired Children and Youth was directed 
to the need for research in the area of the achievement 
tests being administered to hearing impaired students. 
Only the Form B Elementary Level Reading Sub-test 
of the 1958 Metropolitan Achievement Test had been 
standardized for hearing impaired students at that 
time; therefore, most programs were presumably using 
tests normed only on normally hearing students. Obvi- 
ous questions about the reliability and validity of test 
scores arise when a test is administered to persons 
for whom it was not designed and upon whom it was 
not standardized. Part of the resources of the Annual 
Survey was therefore committed to delermirting the 
suitability of such tests for hearing impaired students 
and» to the extent necessary to obtain accurate 
measurement, to devising modified test materials and 
procedures. 

Because of the complexity involved in evaluating 
the appropriateness of such a test, efforts were con- 
centrated on one test. The Stanford Achievement Test 
was selected for study on the basis of data obtained 
at the time of the first Annual Survey indicating that 
the Stanford was the most commonly used test in 
educational programs for hearing impaired students. 
Accordingly, two National Achievement Testing 
Programs were conducted by the Annual Survey » in 
1969 and again in 1971, to obtain information on the 
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performance of hearing impaired students on the Stan- 
ford Achievement Test Series.' 

THE PURPOSE OF THE 1972-73 
ACHIEVEMENT TESTING SURVEY 

The first two achi'^.vement testing programs made 
use of the 1964 edition of the Stanford test, then the 
current edition. During 1972 the publishers of the 
Stanford test were engaged in the preparation of a new 
test series, to be published as the 1973 edition of the 
Stanford Achievement Test. The changes from the 
previous (1964) edition were extensive* reflecting the 
changes in school curricula since the early I960's. 



*The data from these programs arc reported in publica- 
tions: Academic Achievement Test Performance ofHearihg 
Impaired Students, United States: Spring 1969. Gallaudet 
College, Office of Demographic Studies, Scries D» Number 

1. Item Analysis of Academic Achievement Tests Hearing 
Impaired Students, United Sfates: Spring 1969, Gallaudct 
College, Office of Demographtc Studies, Series D» Number 

2. Item Analysis of an Achievement Testing Program for 
Hearing Impaired Students, United States: Spring 1971. Gal- 
laudet College, Office of Demographic Studies, Series D, 
Number 8. Academic Achievement Test Results of a 
National Testing Program for Hearing Impaired Students, 
United States: Spring 1971, Gallaudct College, Office of 
Demographic Studies* Series D, Number 9. Studies in 
Achievement Testing, Hearing fmpaired Students, United 
States: Spring 1971, Gallaudct College, Office of Demo- 
graphic Studies, Series D, Number 11, 



After consullaiion with cdiicalors and other profes- 
sionals working with hearing impaired students, il was 
determined that further achievement testing activities 
of the Annual Survey should use the new edition of 
Ihe Stanford, i/it were slill the case that the Stanford 
series was ihe most widely used achlevemen( test in 
programs for hearing impaired students. To make this 
determination, a survey of the usage of achievement 
tests iu educational programs for hearing impaired stu- 
dents was begun in Ihe f<iJI of 1972, 

PROCEDURES 

The first step involved an attempt lo identify all 
special ei'ucational programs for hearing impaired stu- 
dents in the United States. In conjunction with many 
sources, especially the Conference of Executives of 
American Schools for the Deaf, a list of more than 
MOO possible programs was constructed. Approx- 
imately 230 programs were deleted from the list either 
because they served only preschool children or 
because a deiermi nation could not be made concerni ng 
Ihe exact nature of the students they served. The 
remaining 864 programs lo which the survey postcard 
was sent were divided into three groups on the basis 
of the degree of their involvement with Annual Survey 
data collection activities in the past. It was assumed 
that the degree of past involvement with the Annual 
Survey would be a factor associated with the type of 
achievement test used in the vario'.is programs. In line 
with this assumption Ihe results which follow will be 
reported for each of three levels of involvement. 

The first group of 280 programs consisted of those 
programs which had participated in the 1971 Achieve- 
ment Testing Program and which also supplied demo- 



graphic information to the Annual Survey for lhal 
year. A total of 292 programs participated in (he 1^1 
program, but this number dropped to 280 due to the 
consolidation of some programs and the discontinua- 
tion of others. 

The second group, consisting of 3.^6 programs* 
included those who reported demographic information 
to the Annual Survey* but had not participated in the 
P>71 testing program. 

The third group of 228 programs consisted of 
those which had nol participated in the 1971 testing 
program and were not supplying demographic infor- 
mation to the Annual Survey* but were known to be 
still in operation, providing special educational ser- 
vices to hearing impaired students. 

The survey postcard* a copy of which is 
reproduced below» was then sent lo each of the pro- 
grams in the three groups described, along with appro- 
priate explanatory materials describing the purpose of 
the survey and the method of answering the survey 
questions, A follow-up mailing, again containing a 
copy of the survey postcard and explanatory materi- 
als, was sent lo those programs which had not 
responded to the original mailing within approximately 
one month, 

RESULTS OF THE SURVEY 

A total of 735 programs out of the 864 contacted 
responded to the survey, for an overall response rate 
of 85.1 percent. The response rates for the three 
groups of programs described above appear in Table 
I -A. The response rates for Groups t and 2 (programs 
participating in the Annual Survey) arc both substan- 
tially higher than the rate for Group 3 (programs nol 



NATIONAL SURVEY OF ACHIEVEMENT TESTING WITH HEARING IMPAIRED STUDENTS 



NAME 

TITLE 

1. Are you administering a standardized 
achievement test to your hearing impaired 
students during this 1972-73 school year? 

□ YES □ NO 

If ''YES" please answer Questions 2. 3, and 4, 
If "NO" please answer Question 2. 

2. Do you plan to administer a standardized 
achievement test to your hearing impaired 
students NEXT YEAR (1973-74 school 
year) 

□ YES □ NO 



3. Which achievement test(s) are you ad- 
ministering thii year? Check all that apply. 

□ Stanford Achievement Test, 1964 

□ Stanford Early School Ach, Test 

□ Metropolitan Ach. Test, 1970 

□ Metropolitan Ach, Test, 1958 

□ Jowa Test of BasfC Skrils 

□ American School Ach. Tests 

□ California Ach, Tests, 1970 

□ California Ach. Tests, 1957 

□ Wide Range Achievement Test 

□ Gates-MacGinitie Reading Tests 

□ Gray-Votaw-Rogers Test 

□ Other 

(namt of f«it) 

4, Approximate number of Hearing Impaired 
Students to be tested , 
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TABLE 1: NUMBER AND PERCENT OF MAILSURveV RESPONSES AND USABLE DATA. AND EXTENT 
OF ACHIEVEMENT TESTING AMONG RESPONDENTS FOR THE 1972-73 SCHOOL YEAR. 



1-A: NUMBER AND PERCENT OF RESPONSES TO THE MAIL SURVEY. 



Program Category 


Program! Contacted 


Responses Received 


Number 


Percent 


Number 


Percent 


All Programs 


864 


100 


735 


85.1 


Group 1 


280 


100 


250 


89.3 


Group 2 


356 


100 


320 


89.9 


Group 3 


228 


100 


165 


72.4 



I B: NUMBER AND PERCENT OF USABLE DATA AMONG RESPONSES TO THE MAIL SURVEY. 



Program 
Category 


Data Received 


Data Inapplicable 


Data Unusable. 


Data Usable 


Number 


Percent 


Number 


Percent 


Number 


Percent 


Number 


Percent 


AH Programs 


735 


100 


69 


9^ 


30 


u 


636 


86.5 


Group 1 


250 


100 


4 


1.6 


3 


12 


243 


97.2 


Group 2 


320 


100 


43 


13.4 


20 


6.3 


257 


80,3 


Group 3 


165 


100 


22 


13.3 


7 


4,2 


136 


82.5 



\ C: NUMBER AND PERCENT OF RESPONDING PROGRAMS TESTING DURING THE 1972-73 SCHOOL 
YEAR. 



Program Category 


Usable Responses Received 


Programs Testing 


Number 


Percent 


Number 


Percent 


All Programs 


636 


100 


375 


59,0 


Group 1 


243 


100 


199 


81.9 


Group 2 


257 


100 


118 


45.9 


Group 3 


136 


100 


58 


42.6 
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participating in the Annual Survey). In 69 cases the 
information obtained on the survey postcard or in an 
accompanying letter indicated thai the program was 
not appropriate for the survey, since the program pro- 
vided no educational services* was intended solely for 
preschool, mentally retarded, or dearbh'nd students, 
or was inappropriate for other reasons. In another 30 
cases the responses to the survey were unclear or con- 
tradictory and were unable to be verifled via telephone 
follow-up. Table 1-B shows the number and percent 
of responses in each of these categories for the three 
groups of programs and the number and percent of 
usable responses. Table l-C indicates that, of the 
three groups of programs, Group 1 contained the high- 
est proportion of programs intending to administer an 
achievement test to their students during the 1972-73 
school year. This trend is to be expected since* by 
definition. Group 1 programs were sufficiently 
involved in achievement testing to have agreed to join 
the 1971 National Testing Program and thus to have 
administered at least the Stanford Achievement Test 
during the 1970-71 school year. Less than half the 
programs in Groups 2 and 3 indicated plans to use 
an achievement test during the current school year. 

The responses to the survey questions regarding 
testing plans for the current year and for the sub- 
sequent year fell into six categories: 

(1) testing both this year and next year; 

(2) testing this year but not next year; 

(3) testing this year but unsure of next year; 

(4) not testing this year but testing next year; 

(5) not testing this year and unsure of next year; 

(6) not testing either year. 



Table 2 shows the number and percent of programs 
in each of the three groups whose responses fell into 
the six categories described above. The responses 
indicate that a majority of programs in all three groups 
(87.6 percent, 59.9 percent* and 58,9 percent for 
Groups 1, 2» and 3 respectively) plan to use an 
achievement test during at least one of the two years 
surveyed. 

On the postcard questionnaire, the respondents 
were directed to ''check all that apply'' in indicating 
the achievement tests they planned to administer dur- 
ing the 1972-73 school year. Since the Stanford 
Achievement Test was the most frequent choice, the 
data are displayed in Table 3 in relation to the selection 
of that test. The three resulting categories are: 

(1) using only the Stanford test; 

(2) using the Stanford test along with some other 
achievement test(s); 

(3) using only some test other than the Stanford 
lest. 

Table 3 displays the survey results in these three 
categories, both for the numbers of programs choosing 
each possibility and for the number of students to be 
tested under each condition. Examination of Table 3 
indicates that 75 percent of the programs in Group I 
chose the Stanford lest either exclusively or in combi- 
nation with other tesis. However, most programs in 
Groups 2 and 3 (62 percent and 66 percent respec- 
tively) selected tests other than the Stanford. In terms 
of the numbers of students being tested, 84 percent 
of the students in Group I programs, 65 percent of < 
thosw' in Group 2 programs, and 50 percent of those 



TABLE 2: NUM8ER AND PERCENT OF RESPONDING PROGRAMS IN EACH OF THREE GROUPS OF 
PROGRAMS, ACCORDING TO THE PATTERN OF RESPONSE REGARDING TESTING PLANS 
FOR THE 1972-73 AND 1973 74 SCHOOL YEARS. 



Category of 


All Groups 
Combined 


Group 1 


Group 2 


Groups 


Testing Plans 


Number 


Percent 


Number 


Percent 


Number 


Percent 


Number 


Percent 


TOTAL 


636 


100 


243 


too 


257 


100 


136 


too 


Testing Both Years 


347 


54.6 


186 


76.5 


107 


41.6 


54 


39.7 


Testing 72 73, Unsure 73-74 


21 


3.3 


10 


4.1 


9 


3.5 


2 


1.5 


Testing 72-73, /Vof 73-74 


7 


1.1 


3 


1.2 


2 


0.8 


2 


1,5 


A/of testing 72-73, 
testing 73-74 


72 


11.3 


14 


5.8 


36 


14.0 


22 


16.2 


A^of testing 72-73. 
unsure 73-74 


39 


6.1 


15 


6.2 


19 


7.4 


5 


3.7 


Not testing either year 


150 


23.6 


15 


6.2 


84 

,. _ .. - — 


32.7 


51 


37.5 
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TA8LE 3: FREQUENCY OF TEST SELECTION RELATIVE TO THE STANFORD ACHIEVEMENT TEST. 





PROGRAMS 


STUDENtS 




TOTAL 


Stanford 
Ten Only 


Stanford with 
Other Tests 


Other 
Tests* 


TOTAL 


Stanford 
Test Only 


Stanford with 
Other Tests 


Other 
Tests* 


AU Groups 


376 


109 


106 


160 


29,023 


10,549 


11J43 


6,731 


Group 1 


199 


81 


69 


49 


21,990 


8,752 


9,682 


3.356 


Group 2 


US 


22 


23 


73 


4,447 


t,272 


944 


2,231 


Group 3 


58 


6 


14 


38 


2,586 


525 


1,117 


944 



•Includes those responses which indicated that 3 specific test had not been decided upon. 



in Group 3 piograms were in programs planning to 
use the Stanford lest, either alone or in conjunction 
with other tests. Since in Groups 2 and 3 the majority 
of proi^mms chose tests other than the Stanford, 
while the m^ijority of students were receiving the 
Stanford test, it is apparent that programs with larger 
student enrollments are more likely to use the Stanford 
test than are smaller schools. Table 4 shows the aver- 
age number of students being tested per program, by 
program group and lest selection category. 



TABLE 4: THE AVERAGE NUMBER OF STU- 
DENTS TESTED PER PROGRAM IN 
1972-73 BY GROUP AND TEST SE- 
LECTION CATEGORY. 





Total 


Stanford T«$t 

Only 


Stanford with 
Other T«st> 


Other 
T«ta* 


All Groups 


77,4 


96J 


110.8 


42.1 


Group 1 


110.5 


108.0 


140.3 


68.5 


Group 2 


37.7 


57.8 


41.0 


30.6 


Group 3 


44.6 


87,6 


79.8 


24.8 



•Includes those respoo$e» which indicated that a specific 
test had not been decided upon. 



Tables 5 and 6 present the detailed information 
upon which Table 3 was based. The number of pro- 
grams selecting each test is reported in Table 5. Ta- 
ble 6 shows the number of students being tested with 



each specific achievement test. Columns headed by 
the name of a specific achievement test present data 
for situations in which that lest tilone was selected. 
Combinalions of tests are reported in the third and 
fourth columns, headed **SAT with others'' and 
•'Others in Combination.'* 

SUMMARY AND CONCLUSIONS 

A mail survey regarding the usage of achievement 
tests was sent to 864 educi^lional programs for hearing 
impaired students throughout the United States. A 
total of 735 responses was received, for a response 
rate of 85.1 percent. Ninely-nine leplies were 
eliminated, either as coming from inappropriate pro- 
grams or as being undecipherable. Of the remaining 
636 usable replies, 375 (59 percent) indicated plans 
. to use an achievement test during the 1972-73 school 
year, for a total of 29,023 students to be tested. Of 
the programs indicating testing plans for the current 
school year (1972-73), 215 programs (57 percent) 
reported plans to use the Stanford Achievement Test, 
either alone or in combination with some other 
achievement lest. These 215 programs would be test- 
ing 22,292 students, or 77 percent of the total reported 
as being tested with any achievement lest this year. 
The Stanford test is clearly the most frequently used 
lest among these programs, whether considered as 
the only achievement test being used or as one of a 
combination of tests being used by the reporting pro- 
grams. The survey resuhs indicate that the Stanford 
alone will be administered to 10,549 students; the next 
mosl frequently used single test is the 1970 Metropoli- 
tan Achievement Test, being administered to 681 stu- 
dents. 



« 



ERIC 



The abbreviations for the various achievement tests listed in the postcard questionnaire which 
appear in Tables 5 and 6 on the succeeding pages are as follows: 



SAT Stanford Achievement Tost» 1964 

SESAT Stanford Early School Achievement Test 

70 MAT Metropolitan Achievement Test, 1970 

'58 MAT Metropolitan Achievement Test, 1958 

Iowa Iowa Test of Basic Skills 

Americ American School Achieven^ent Tests 

70 Cai California Achievement Tests, 1970 

'57 Cal California Achievement Tests. 1957 

WRAT Wide Range Achievement Test 

GMAC Gales — MacGinilie Reading Tests 

GVR Gray — Votaw — Rogers Test 
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TABLES: NUMBER OF PROGRAMS ADMINISTERING EACH ACHIEVEMENT TEST IN 1972-73 BY 
PROGRAM AND RESPONSE CATEGORIES. 





AN 
Tests 


SAT 
•oly 


SAT al 
•theft 


Others 

Com* 
bination 


StSAT 


70 
Hat 


SI 


Iowa 


Amertc, 


'70 

Km. 


'S7 


UUD AT 




V» Vn 


uinert 


Unknown 


AH Rispoiidfnb 
Ttjtinfl Thi» Yiir 


375 


109 


106 


57 


1 


20 


9 


M 


3 


8 


4 


24 


3 


1 


IS 


3 


Former Ach, Tett. 
Pirticipif>t$ TOTAL 
Ttitio^Thil Ytir 


199 


81 


69 


10 


- 


8 




2 


2 


4 


3 


7 


2 


1 


2 


3 


TtstinQ This 
Yiar&Next 


166 


7B 


66 


9 




/ 


S 


2 


2 


4 


3 


5 


1 


1 


2 


3 


Twlift9 This 
Year, Next 
Year Unknown 


10 


4 


3 






1 












1 


1 








TtitiogThii 
Year, Not 
Next Year 


3 


1 




1 


























Participants in 
8aslc Oati Survey 
Ooly: TOTAL 
Tasting This Year 


1)8 


22 


23 


31 


1 


8 




3 




4 


- 




1 




1 


14 




1 


- 


9 


- 


Testing This 
Years Next 


107 


20 


20 


29 


I 


7 


3 


3 




1 


1 


13 


1 




8 




Testing This 
Year, Next 
Year Unknot^n 


A 


2 


3 


2 




1 
















... 


1 




Testing This 
Next Year 


2 


- 


- 


- 


- 


- 




1 




- 


- 


1 


- 




- 


- 


Non participants in 
Both: TOTAL Testing 
This Year 


58 


6 




16 


- 


4 


1 


6 


1 


3 


- 


3 


- 








Testing This 
Years Next 


M 


5 


13 


18 




4 


1 


6 


1 


3 




2 






3 


1 


Testing This 
Year. Next 
Year Unknown 


2 




1 
























1 




Testing This 
Year, Not 
Next Year 


2 


1 




















1 
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TABLES: NUMBER OF STUDENTS ADMINISTERED EACH ACHIEVEMENT TEST IN 1972-73 BY PRO- 
GRAM AND RESPONSE CATEGORIES. 





All 
Tests 


SAT 

only 


SAT w/ 
others 


Olhers 

In 

Com 
faination 


SESAT 


'70 
MAT 


'58 
MAT 


Iowa 


Amiric. 


'70 
Cai. 


'57 
Cel. 


WRAT 


GMAC 


GVA 


Others 


Unknown 


Ail Rtipondents 
Testing This Year 


29,023 


10,549 


11,743 


1,993 


6 


681 


594 


285 


)95 


461 


950 


515 


200 


219 


480 


152 


Former Ach. Te<t. 
Piflicipanti: TOTAL 
teiting This Year 


21,990 


8.752 


9.882 


429 


,■•„•:•:..:..- 


462 


371 


33 


190 


435 


800 


145 


^80 


219 


140 


162 


Testing This 
Year & Next 


20,944 i 
971 1 


8,058 


9,599 


404 


- 


370 


371 


33 


190 


435 


800 


103 


2^ 


219 


140 


152 


Teiting This 
Year, Next 
Year Unknown 


680 


83 


















6 


110 








Testing This 
Year, Not 
Next Year 


75 i 


T 

u 1 


25 








■ 










36 


- 








Participants in 
Basic Data Survey 
Onfy: TOTAt 
fisting This Year 


4,447 1 


1.272 


944 


1.055 


6 


193 


21 


- 

25 


- 


15 


150 


308 


20 


- 


242 




Testing This 
Yeaf&Ne^t 


4,104 ] 


1,129 


854 


973 


6 


186 


21 


24 


- 


15 


ISO 


300 


20 


- 


230 




Testing T*'is 
Year, Nexi 
Year Unknown 


334 1 


t ' - 

143 


1 -1 

90 


82 




7 


- 


- 




- 






- 


- 


12 




Testing This 
Year, Not 
Next Year 


9 i 

ri 








_ 


- 


_ 


I 




_ 




8 










N on participants in 
goth: TOTAL Teitiog 
This Year 


t 

_ 586 t 


J25^ 


1,117 


509 




28 


6 


227 


5 


11 




,62 






98 




Testing This 
Year & Next 


2.S10 \ 


516 


: 

1,087 


509 




26 


6 


227 


5 


It 




SS 






66 




Testing This 
Yeaf, Next 
Year Unknown 


.... ... ..J. 

'bo 


— 


- -- 

30 
























30 




Testing This 
Year, Not 
Ne«tYear 


16 


9 






L.. -Z 




L. ^ . 










7 
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APPENDICES 



Appendix \: CharacterlsticsofSludentsPartlclpatIng 
in the Achievement Testing Program 
and the Annual Survey of Hearing 
Impaired Children and Youth 

Appendix II: Backgroundof the Achievement Testing 
Program 

Appendix IH: Standardized Testing Procedures Devel- 
oped for the Spring 1971 Achieve- 
ment Testing Program 

Appendix IV: Schools and Classes that Participated In 
the Achievement Testing Program 



APPENDIX I 



CHARACTERISTICS OF STUDENTS PARTICIPATING 
IN THE ACHIEVEMENT TESTING PROGRAM 

AND THE ANNUAL SURVEY OF 
HEARING IMPAIRED CHILDREN & YOUTH 



Included here is a summary of Ihe demographic characlerislics of the sludenls for whom achievemciit le t 
results have been reported. Also shown are the distributions for these variables on the 41,109 students who 
participated in the Annual Survey of Hearing Impaired Children and Youth during the 1970-71 school year. 

Preceding each table is the definilion of the variable presented in the table. 



AGE 



The age of the students is the age as of December 31 , 1970. 





Students in the 


Ail Students in the 


Age of Students 


Achievement Testing Program 


Annual Survey of Hearing 








Impaired Children & Youth 




Number 


Percent 


Number 


Percent 


Total 


16,908 


100.0 


4U09 


100.0 


Under 6 Years 


31 


.2 


5,387 


13.1 


6 • 9 Years 


2,463 


14.6 


12,119 


29.5 


10 -13 Years 


6,760 


40.0 


12.275 


29.9 


14 - 17 Years 


5,587 


33<0 


8.661 


2M 


18 Years & Over 


2.067 


122 


2.667 


6.5 



BETTER EAR AVERAGE 

The beiler ear averages were determined by averaging the puretone thresholds for the speech range (500, 
1000, and 2000 Hz) in the better ear. Better ear averages are given in decibels according to the ISO 
standard, For the purposes of tabulations, audiological data reported in the ASA standard were converted 
to the ISO standard by addinf? ten decibels to the ASA average. If the standard was not reported but a 
belter ear average could be computed, the results were treated as if reported in ISO standard. The category 
"Information Not Available*' includes those students for Whom no audiological information was reported 
and those for whom belter ear averages could not be determined due to the omission of results for one or 
more of the frequencies used to compute the average. 



Better Ear Average 


Students In the 
Achievement Testing Program 


All Students in the Annual 
Survey of Hearing Impaired 
Children and Youth 


Numt>er 


Percent 


Number 


Percent 


Total Students 


16,908 


100.0 


41,109 


100.0 


Information Not Available 


2,890 


17,1 


9,055 


22.0 


Total Known Inforrr^ation 


14,018 


100.0 


32,054 


100.0 


Under 25 dB 


106 


.8 


1,126 


3.5 


25' 39 dB 


234 


1.7 


1,697 


5.3 


40 - 54dB 


652 


4.7 


2,388 


7.4 


55 . 64 dB 


969 


6,9 


2,498 


7.6 


65 ' 74 dB 


1,543 


11.0 


3,541 


11.0 


75 • 84 dB 


2.019 


14.4 


4,301 


13.4 


85 dB & Above 


8,495 


60,6 


16,503 


51.5 



AGE AT ONSET OF HEARING LOSS 



Iliis table shows the age of the student when he lost his hearing. The category "Information Not Reported'* 
includes students for whom this information was omitted and those for whom the response of **Unknown** 
was reported. 



Age at Onset of 
Hearing Loss 


Students in the 
Achievement Testing Program 


All Students in the 
Annual Survey of Hearing 
Impaired Children & Youth 


Numl>er 


Percent 


Number 


Percent 


Total Students 


16,908 


100.0 


41,109 


100.0 


Information Not Reported 


2,319 


13.7 


6,891 


16.8 


Total Known Information 


14,589 


100.0 


34,218 


100.0 


Onset at Bjrth 


11,269 


77.2 


26,703 


78.8 


Under 1 Year 


921 


6,3 


1,968 


5.8 


1 Year 


999 


6.8 


1,942 


5.7 


2 Years 


621 


4.3 


1,256 


3.7 


3 Years 


328 


2.2 


721 


2.1 


4 6 Years 


355 


2.4 


1,084 


3.2 


7 Years and over 


96 


0.7 


544 


1.6 



AGE HEARING LOSS DiSCOVERED 

Presented in this lable is the reported age the studeni*s hearing loss was discovered. The ^Information Not 
Reported' category includes the cjses where the inrornialion was not available or unknowrj- 



Age Hearing Lo« 
Discovered 


Students in the 
Achievement Testing Program 


All Students In the 
Annual Survey of Hearing 
Impaired Children and Youth 




Number 


Percent 


Number 


Percent 


Tolai Students 


16.908 


100.0 


41,109 


100.0 


tnformation Not Reported 


?,?93 


46.1 


16,621 


40.4 


Total Known Information 


9.115 


100.0 


24,488 


. 100.0 


uiscovereQ ai oirin 


173 


1.9 


347 


1,4 


Under 1 Year 


1,794 


19.7 


4.448 


18.2 


1 Year 


2,442 


26.8 


6.022 


24.6 


2 Years 


1.991 


21.8 


5,095 


20.8 


3 Years 


1.071 


11.7 


2,754 


11.2 


4 . 6 Years 


1.322 


14.5 


4.206 


17.2 


7 Years and Over 


322 


3.5 


1,616 


6.6 



PROBABLE CAUSE OF HEARING LOSS 

This table presents the probable cause of the student's hearing loss. The causes are shown in regard to 
occurrence of loss at bitlh or alter birth. The table i>hows the number of times a particular cause was 
reported. The category 'information Not Reported'' includes those students for whom this information 
was not reported or cases where tlicre was no known cause of ihe loss. If two or more causes were 
attributed to the hearing loss of a child both causes are included. Percent distributions for this table are not 
shown. . 



Probable Cause of 
Hearing Loss 


Students in the 
Achievement Testing Program 


AH Students in the 
Annual Survey of Hearing 
Impaired Children and Youth 


Total Students 


16.908 


41.109 


Information Not Reported 


8,510 


19,916 


Causes at Birth 






Maternal Rutjella 


1,408 


6.077 


Other Complications of Pregnancy 


607 


1,518 


Trauma at Birth 


405 


916 


Prematurity 


944 


2,207 


Rh Incompatibility 


708 


1,402 


Hereditary 


1,626 


3,073 


Other Causes at Birth 


420 


844 


Causes After Birth 






Meningitis 


896 


2.017 


Mumps 


10? 


351 


Meastes 


491 


1J14 


Otitis Media 


192 


927 


Trauma 


181 


420 


Fever 


258 


628 


Other Causes After Birth 


966 


2,000 
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AGE STARTED EDUCATION PRIOR TO AGE SIX 



Tliis table presents data regarding tlie age a sludeni began W\% educalion prior lo age six. The category 
'*Soine I'ducation* Uul Age Started Unknown'* includes those who had educational training prior to age six* 
hut tlie actual ages of the children when ihey started this training are unknown. 



Age Started Education 
Prior to Ago Six 


Students in the 
Achievement Testing Program 


All Students In the Annual 
Survey of Hearing Impaired 
Children and Youth 




Number 


Percent 


Number 


Percent 


Total Sludenis 


16.908 


100.0 


41,109 


100,0 


information Not Reported 


4,331 


25.6 


9.049 


22 0 


Total Known Information 


12,577 


100.0 


32.060 


100.0 


1 Year 

2 Years 

3 Years 

4 Years 

5 Years 

Some Education, but Age 

Started Unknown 
No Education Prior to Age Six 


192 
620 
2.046 
2,280 
2,614 

731 
4,094 


1.5 
4.9 
16.3 
18.1 

20.8 

5.8 
32,6 


1.122 
2,912 
5,800 
5,367 
6,134 

2,185 
8,540 


3.5 
9.1 
18.1 
16.7 
19.1 

6.8 
26.6 



HISTORY OF PARENTAL DEAFNESS BEFORE AGE SIX 

Shown here are the number of students whose parents either had normal hearing before age six or suffered 
a hearing loss prior lo this age. The number refers to the number of students and not the number of 
parents. 



History of Parental Deafness 
Before Age Six 


Students in the 
Achievement Testing Program 


All Students In the 
Annual Survey of Hearing 
Impaired Children and Youth 




Number ^ 


Percent 


Number 


Percent 


Total Students 


16,908 


100.0 


41,109 


100.0 


Information Not Reported 


4,596 


27.2 


12,515 


30,4 


Tolat Known Information 


12,312 


100.0 


28,594 


100.0 


Both Parents Normal Hearing 


10,909 


88.6 


25.506 


89.2 


Both Parents With Loss 


612 


5.0 


1,044 


3.7 


One Parent With Loss 


474 


3.8 


M61 


4.1 


One Parent Normal Hearing, 










Information for Other Parent 










Not Reported 


317 


2.6 


883 


3.1 
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ADDITIONAL HANDICAPPING CONDITIONS 

Additional handicapping conditions refers to educationally significant handicaps the students had in addi- 
tion to Impaired hearing. The table shows the number of times a particular handicapping condition was 
reported. The category **Niimber with No Handicaps*' refers to those students for whom it was staled that 
no additional handicaps were present. The "Information Not Available*' group includes those students for 
whom this informallon was not reported. The category ''Total Number of Conditions" is the summation of 
all the handicapping conditions reported and not the number of students having these conditions. If a 
student had two additional handicaps, both handicaps are included. Percent distributions for this variable 
are not shown. 



Additional Handicaps 


Stuoenti In the 
Achievement Teiting Proflram 


AU Students in the Annual 

Survey of Hearing 
Impaired Chifdrert and Youth 


Total Students 


16,908 


41,109 


Number with no Handicaps 


10,676 


23.874 


Information Not Available 


2,201 


6,255 


Total Number of Conditions 


4,726 


13,662 


Brain Damage 


63 


168 


Cerebral Palsy 


432 


1.123 


Cleft Lip or Palate 


54 


214 


Emotional and Behavioral Problems 


1,233 


3,338 


Epilepsy 


78 


226 


Heart Disorders 


158 


750 


Learning Disabilities 


459 


910 


Mental Retardation 


782 


2.440 


Orthopedic Disorders 


88 


250 


Perceptual Motor Disorders 


657 


1.885 


Severe Visual 


477 


1,699 


Other 


245 


659 



APPENDIX II 



Background of 
The Achievement Testing Program 



The Office of Demographic Studies first became 
involved in the area of achievement testing in the 
spring of 1969. One of the important areas in which 
data were needed, according to the projecrs National 
Advisory Committee, was that of the outcomes of the 
educational process as measured by achievement 
tests. Information subsequently obtained from educa- 
tional programs for the hearing impaired indicated that 
the Stanford Achievement Test was the most widely 
used measure of academic achievement for hearing 
impaired students. Consequently, the Stanford Series 
was used in a national survey of achievement testing 
of hearing impaired students conducted during the 
spring of 1%9. The results of the more than 12,000 
tests administered during that first program confirmed 
the general knowledge of educators of the deaf that 
hearing impaired students score substantially befow 
average levels of achievement attained by their hear- 
ing agemates. ' Of greater importance was the fad that 
the results indicated that large numbers of the students 
tested were receiving lest batteries too advanced for 
their achievement level, with the result thai many 
scores were at or below the level where guessing or 
random response becomes a major determinant of the 
obtained scores. It was therefore necessary to revise 
the measuring instruments themselves before an 
adequate measurement of the achievement of hearing 
impaired students could be obtained. 

A second National Testing Program was under- 
taken in the spring of 197 1, incorporating three innova- 
tions designed to handle the technical measurement 



problems encountered two years earlier. These were 
(I) a screening test procedure to determine the appro-- 
priate level at which a student should be tested; (2) 
practice tests to familiarize students with the 
mechanics of lesl-laking, a set of skills which seemed 
to be deficient in many of the students tested in 1969; 
and (3) a modification of the sub-tests which in the 
original version of the test were intended to be dictated 
by the teacher. The dictated items were, instead* 
printed in the sludenf s test booklet so thai the benefits 
of both dictation and reading of the item were available 
to the hearing impaired student, it is upon the data 
from this second National Testing Program that the 
studies in the present report have been based. 



DESCRIPTION OF 

THE STANFORD ACHIEVEMENT TEST 

The Stanford tests are described by their authors 

as: 

. . * comprehensive achievement tests 
developed to measure the important 
knowledges, skills, and understandings 
commonly accepted as desirable outcomes 
of the major branches of the elementary 
curriculum. The tests are intended to pro- 
vide dependable measures of these out- 
comes, comparable from subject to subject 
und grade to grade, for use in connection 
with improvement of instruction, pupil 
guidance, and evaluation of progress.* 



*The results of ibis program have been presented in detail 
in publicauons and D-2 from the Office of Demographic 
Snjdies, listed on the inside back cover. 



*Kelley, T. L,, Madden. R., Gardner, B. R, and Rudman, 
C. Stanford Aihieyement Te.\f: Oirecihns for Adminh* 
terinfi Printarv I Baifery, New York: Harcourt, Brace A 
World, inc.. 1965, p. 2. . 



I he W\ N;il; »n.il I cslifi^ 1*10^:1 iuii u^cd I'oim \V of 
Ihc lyM edition i^r Ihc SumtorJ IcsUoi Ihc ovciull 
rostiiii: l-oini X nf ihc l%4 edition was used for the 
screening test proctoure and for the reicsiing in the 
reliahiliiy stiid> tescrihcd in this publicivlion. liach of 
the five bullerics of this 1964 edition (Primary i. Pri- 
nuny I J, liitei n\ediiite I, Inlefniediatc II, and 
Advanced) covers academic niateri«ils in vai imis sub- 
ject areas appropriate fiM students within a specific 
ijrade range, b'or example, the Primary I battery is 
intended for tise liiMii the middle of Clrade 1 to the 
middle of Cirade 2. The titles i>f the sub-tests included 
in each t>altery are listed in lable A. 

The content i>t* the Stantord tests was based on 
a survc) of the materials typicaily included in rei:iilar 
school curricula at the various giade levels included 
in the icsi, and Ihe siandardi/ation of Ihc final form 
of the (est was carried oiU in school systems across 
the country. Curricula for the hearing impaired were 
not surve>ed. and Ciiucalional prv>gran^s for the hear- 
ing impaired were not included in the stanJardi/atit>n 
procedures. 



PARTICIPANTS IN 

THE 1971 NATIONAL TESTING PROGRAM 

All educational progran)s for the hearing impaired 
known to the Annual Suivey in fall of 1970, 776 pro- 
grams emolling appro\imatel> 48.(KH1 sluilents, were 
contacted by letter and invited to participate in the 
testing program, lest materials and scoring services 
were offererd free of charge to the participating pro- 
grams. A total of 292 progran\s accepted the invitation 
and tested iwer 19, (KK) students. Partici,>aiion was vol- 
untary on the pait of the educational programs, and 
ao follow-up etTorl was employed to encourage non- 
resp.indents or non-participating progiams to partici- 
pate in the national testing. The reason most fre- 
quently cited for non-participation was that the given 
program enrolled only preschool students or other stu- 
dents too young to be tested. Other progiams declined 
pailicipation because they had insuHllcicnt staff to 
administer the tests, because they were complying 
with school district testing piogiams using tests other 
than the Stanfoid, because they were itinerant pro- 
grams with small numbers of students scattered across 



TABLE A: SUB TESTS CONTAINED IN SUCCESSIVE BATTERY LEVELS OF THE STANFORD ACHIEVE- 
MENT TEST SERIES. FORM W. 



Primary I 


Primary II 


Intermediate 1 


Intermediate (1 


Advanced 


Word Reading 


Word Meaning 


Word Meaning 


Word Meaning 




Parag Meaning 


Parag. Meaning 


Parag. Meaning 


Parag. Meaning 


Parag. Meaning 


Vocabulary 


Science & Social 
Studies Concepts 








Spelling 


Spelling 


Spelling 


Spelling 


Spelling 


Word Study Skills 


Word Study Skills 


Word Study Skills 








Language 


Language 


Language 


Language 




Arithmetic 
Computation 


Arithmetic 
Computation 


Arithmetic 
Computation 


Arithmetic 
Computation 


Arithnnetic 


Arithmetic 
Concepts 


Arithmetic 
Concepts 


Arithmetic 
Concepts 


Arithmetic 
Concepts 






Arithmetic 
Applications 


Arithmetic 
Applications 


Arithmetic 
Applications 






Social Studies 


Social Studies 


Social Studies 






Science 


Science 


Science 



wide geographic;!) iireas, and t^ccause of reservations 
about adminisiciing the Slanford tests to hearing 
impaired students. The final numbers of students who 
were tested at battery level are reported in Table 13. 



QUALIFICATIONS AND 

IIMITATJONS OF 

THE TESTING RESULTS 

Many of the qualifications and limitations of the 
testing results have been stated in previous publica- 
tions from the Office of Demographic Studies dealing 
with the 1971 testing program.^ and the reader is urged 
to review these statements before making use of the 
information contained in this report. Foremost among 
these is» of course, the fact that the Stanford test, 
reflecting, as it does, the curriculum of regular 
schools, has been developed and standardized for 
hearing students: consequently, any difYerences 
between the curriculum of regular schools and special 
educational programs for hearing impaired students 
will tend not only to reduce the scores for hearing 
impaired students but also the validity and reliability 
of the lest results. 

Also of major concern is the non-random method 
of selection of students for inclusion in the testing 
program. Appendix I of this publication reviews the 
demographic characteristics of the students tested in 
the 1971 program in relation to the characteristics of 
all students for whom information is available to the 
Annual Survey. Examination of these data suggests 
thai the differences are not great except in the case 
of the age distribution. This is an expected and accept- 
able deviation, since preschool students and students 
under age 8 (who constitute a substantial proportion 
of the total Annual Suivey group) are not ordinarily 
tested with achievement tests of the Stanford type. 

Another characteristic of the age distribution is 
noteworthy, namely, the age distributions of students 
taking particular battery levels. The age range of hear* 
ing impaired students receiving a given battery is sub- 
stantially broader than that encountered among hear- 
ing students. For example, 155 students aged 18 or 
above received primary level test batteries on the basis 
of screening test scores indicating that their achieve- 
ment levels are within the primary range. Regardless 
of the accuracy of such assignments of testing levels, 
the presumed disparity between the content matter of 
primary level tests and the typical interest patterns 
of 18-year old students introduces a source of extrane- 
ous variance unrelated to actual academic ability but 
related instead to the motivational characteristics of 
older students being asked to respond to such materia 
als. This is a measurement problem which will need 



TABLE B: NUMBER OF ACHIEVEMENT TESTS 
ADMINISTERED ACCORDING TO 
TEST BATTERY LEVEL: SPRING 1971. 



Test 
Battety Lmt 


Number 


Petcent 


All Levels 


19.037 


100.0 


Primary 1 


6.786 


35.6 


Primary II 


6,655 


35.0 


Intermediate 1 


3.215 


16.9 


Intermediate II 


1.566 


8,2 


Advanced 


815 


4.3 



to be handled in some other manner in future testing 
programs. The age distributions of hearing impaired 
students receiving each of the five batteries are pre- 
sented in Table C. 

The reports contained in this and previous publi- 
cations regarding the 1971 Achievement Testing Pro- 
gram have presented data relating to the item analysis 
figures, means, and standard deviations of grade 
equivalents obtained by hearing impaired students 
according to degree of hearing loss, patterns of difTer- 
enlial performance between the hearing impaired and 
standardization groups, reliability, and discriminative 
validity of the tests used in the 1971 program. Future 
reports will concentrate on the influence of other 
demographic char^cterstics on the achievement levels 
of hearing impaired students, on the influence of 
guessing or ran^^om response on the test scores, and 
on the interccrrelalions among the sub- tests of each 
achievement battery. The achievement testing 
activities of the Office of Demographic Studies con- 
tinue to be directed to the goal of improving the accu- 
racy and usefulness of the tests used in the field of 
education of hearing impaired children and youth and 
to the assessment of the outcomes of the educational 
process by means of such improved tests. 



*S<e Office of Demographic Studies publication D-S, pp. 
2-3, and pubticaiion D-9, pp. 6-7. 



TABLE C: NUMBER OF STANFORD ACHIEVEMENT TESTS INCLUDED IN THIS REPORT BY AGE AND 
TEST BATTERY LEVEL: SPRING 1971. 





Battery Level 


All 
Levels 


Prirrtary 
1 


Primary 
II 


Intermediate 
1 


Intermediate 
II 


Advanced 


All Ages Tested 


19,037 


6,786 


6,655 


3,215 


1,566 


815 


Unknown Age 


2,129 


800 


722 


394 


125 


88 


Total Students Includea 
in This Report 


16,908 


6,986 


5,933 


2,821 


1,441 


727 


Under 6 


31 


27 


2 


1* 


1* 




6 


341 


335 


3 


2 


r 




7 


454 


425 


25 


2 


r 


r 


8 « 


697 


606 


85 


6 






9 


971 


718 


238 


11 


3 


r 


10 


1,297 


779 


466 


42 


9 


r 


11 


1,600 


765 


737 


72 


25 


r 


12 


2,316 


913 


1.092 


232 


66 


13 


13 


1,547 


401 


758 


288 


84 


16 


14 


1,573 


352 


674 


392 


117 


38 


15 


1,455 


230 


538 


409 


215 


63 


16 


1,315 


161 


451 


355 


210 


138 


17 


1,244 


119 


361 


375 


239 


150 


18 


1,154 


108 


300 


325 


248 


173 


19 


639 


35 


142 


208 


152 


102 


20 


222 


10 


47 


86 


54 


25 


21 & O ver 


52 


2 


14 


15 


16 


5 



♦These results are highly improbable and may reflect, an error in scoring or the age given for the student who took the test. 



APPENDIX ill 

Standardized Testing Procedures Developed for 
the Spring 1971 Achievement Testing Program 



The analyses of data collected from the 1969 
Achicvemcnl Testing Program indicated thai different 
methods of adminisleiing the tests were being used 
among individual school and class programs. As lest 
scores can be affected by the manner in which the 
test is given, it became necessary to establish uniform 
testing procedures. This served the purpose of making 
test administration procedures consistent throughout 
the schools and classes participating in the Spring 
1971 testing program. It also ensured that test scores 
would be comparable from teacher to teacher and 
school to school. A description of the standardized 
procedures implemented to collect the data in this 
report is given beluw. 

SCREENING TESTINQ OR 
PRE TESTING OP STUDENTS 

Analyses of the 1969 testing data demonstrated 
that many sub tests, particularly at the Intermediate 
and Advanced battery levels, were not showing true 
differences between good and poor students. This 
occurred mainly because students were receiving test 
battery levels too high or too difficult for ihem.The 
number of items they were able to answer correctly 
was insufftcienl to show actual achievement dif* 
Terences, and scores tended to cluster about a chance 
or guessing range. 

This guessing factor may result in a student*s 
score being spuriously affected by the test battery 
level he receives. Generally, by guessing alone, the 
higher the battery level administered, the higher will 
be the scores. For example, if a beginning first grade 
student were administered the Social Studies Sub*test 
of the Advanced battery and merely guessed at each 
question, he would likely receive a 4»6 Grade Equiva- 
lent score. The criteria used to select test battery 
levels for students varied throughout the country. It 



was therefore necessary to establish valid battery 
selection methods that would be consistent among 
the participating schools. A screening testing pro- 
cedure was implemented to accomplish this goal. 

The selection of the screening lest was, for the 
most part, based on the internal analyses of the 
I2,CX)0 achievement records collected two years 
earlier. The search was to find one sub'tesl within the 
Stanford Series which best indicated how well a 
student would perform on (he remainder of the 
sub-le&is in the full battery. On the basis ol various 
statistical analyses, the Paragraph Meaning Sub-test 
consistently proved lobe the best predictor of overall 
student performance. In setting the specifications for 
using a Paragraph Meaning score to select the full 
battery, statistical adjustments were made which 
allowed for the fact that younger students generally 
scored higher in reading than on other test content 
areas, while older students scored relatively lower on 
reading than in the remainder of the test, e.g., 
Arithmetic Computation. 

Two levels of screening tests were used, one 
appropriate for students achieving at a general level of 
the end of the fourth grade ard below, and one for 
students estimated to be functioning at the beginning 
fifth grade level and above. In ordering screening test 
materials, the participating programs were asked to 
estimate the number of students maintaining a 
general academic level within each of these broad 
categories. The Paragraph Meaning Sub-test from the 
Primary II and Intermediate II batteries of the 
Stanford Series, Form X, were employed as the 
screening instruments. The school administered and 
scored the screening test. The number of items the 
student answered correctly was used to select the 
most valid battery level for htm. Guidelines for using 
screening test scores were formulated and set by the 
Annual Survey. 
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PRACTICE TESTING TO 
INSTRUCT STUDENTS IN 
TEST-TAKING PROCEDURES 

The directions to administer parts of the Stunford 
tests and the question-i^nswer format of some test 
items proved difficult to follow for many students 
in special programs for the hearing impaired. They 
lacked exposure lo this type of testing procedure. 
In analyzing the 1969 achievement test results, it 
became clear that many students took the lest not 
understanding the test structure or how to mark 
their answers. The seriousness of this problem 
led the Annual Survey to develop sets of practice 
tests appropriate to each battery level of the Stanford 
Series. Samples of the test directions, questions, and 
answer marking procedures were included^ in the 
practice materials, along with an explanation of the 
purposes of academic achievement testing. Teacher 
manOals were developed to accompany the practice 
tests. 

Participating programs received a practice test 
for each student and were requested to administer 
them two lo four days prior to the Stanford full 
batteries. The practice tests were lo be used directly 
to teach test-taking mechanics lo the students and 
prepare them for their best performance on Ihe real 
test. As the teachers gave the practice session, they 
became better prepared for administering the Stanford 
tests. 



SPECIAL EDITION OF THE 
PRIMARY LEVEL TEST BATTERIES 

The Primary 1 and II (est levels, those intended 
for the academic range of the middle of Grade I to 
the end of Grade 3, contain many sub-tests stn:ctured 
to be administered by oral presentation. A hearing 
impaired student's response to a dictated question 
may be a function of his receptive communication 
skill and not his knowledge of the answer. Previously^ 
schools attempted various procedures to overcome 
this problem — overheads, blackboards, and the like. 
To standardize presentation of the dictated sub-lesls 
and make their design more valid* the Annual Survey 
arranged with the test authors and publisher for a spe- 
cial edition. This applied to the Primary I and II levels 
only and was called Form W-HI. The Intermediate 
and Advanced test levels are seiradminislering and 
contain no dictated lest questions. 

Within the Form W-HI edition, those lest 
questions previously to be strictly dictated were also 
printed in the lest booklet itself. The teacher was to 
dictate the question and then direct the student to 
read it in his own booklet before marking his answer. 
The procedure served to make uniform the adminis- 
tration of dictated sub-tests. In the Primary I, Form 
W'HI, modifications were made in the Vocabulary 
and Arithmetic Sub-tests. The Science and Social 
Studies Concepts and Arithmetic Concepts Sub-tests 
were modified at the Primary II level, Form W-Hl. 



APPENDIX IV 

SCHOOLS AND CLASSES THAT PARTICIPATED IN THE 
ACHIEVEMENT TESTING PROGRAM 



ALABAMA 

Alabama Institute for the Deaf and Blind 
Blossomwood Elementary School 
Children's Center of Montgomery, Inc. 
Holt Elementary School 

University of Montevallo Speech and Hearing Clir^ic 

ALASKA 

Anchorage Borough School District 

ARIZONA 

Arizona State School for the Deaf and Blind 
Phoenix Day School for (he Deaf 

ARKANSAS 

Jenkins Memorial Children's Center 

CALIFORNIA 

Alhambra City School District 

Anaheim Union High School District 

Bellflowcr Unified School Distiict 

Mary E. Benaett School for the Deaf 

Butte County Schools 

California School for the Deaf, Riverside 

Cedarcreek School for the Deaf 

Cenlfalia School District 

Chula Vista City School District 

Covina Valley Unified School District 

El Cenlro Elementary School District 

Escondido Union School District 

CardcnCrove Unified School District 

Goleta Union Elementary School District 

Kern County Schools 

La Mesa-Spring Valley School District 
^ Lancaster Elementary School District 

Livermore Valley Joint Unified School District 

Lompoc Unified School District 

Marin County Schools 
: Marlcon Elementary School 

Monterey County Schools 



Mt. Diablo Unified School District 
Oakland City Unified School District 
Orange Unified School District 
Pasadena City Unified School District 
Placer County Public Schools 
Riverside Unified School District 
San Bernardino County Schools 
San Diego Unified School District 
San Francisco County Schools 
Sjn iosc City Unified School District 
San Juan Unified School District 
Santa Ana Unified School District 
Santa Clara Unified School District 
Santa Rosa City School District 
Simi Valley Unified School District 
Solano County Schools 
Stockton Unified School District 
Suiter County Schools 
Tehama County Public Schools 
Tulare County Schools 
Tulare Union High School District 

COLORADO 

Colorado School for the Deaf and Blind 
John Evans School 
Meadow Elementary School 

CONNECTICUT 

American School for the Deaf 

Class for Preschool Hearing Impaired Children. 

Hartford 
East Hartford Public Schools 
Green Acres School 

Hamdeti-New Haven Cooperative Educational 

Center 
Magrath School 

Mystic Oral School for the Deaf 

West Haven Department of Special Education 

DELAWARE 

Margaret S/Slerck School for Hearing Impaired 



DISTRICT OF COLUMBIA 

Capital Region Model Secondary Svliool(MSSI)) 
Kendall School tor the Deaf 
Speech and Hearing Center-Pubiic ScliouU of ihe 
District of Columbia 

FLORIDA 

Brevard County Public Schools 
Florida School for the Deaf and Blind 
Leon County Program for Hearing Impaired 

Children 
Robert McCord Oral School 
Pahn Beach County Schools 
Rock Lake Llcnieniary School 

GEORGIA 

Atlanta Public Schools 
Atlanta Sjvech School, Inc. 
Cobb County Board of Lducalion 
Lawion B. Lvans School 
Houston Speech and Hearing School 
Robert Shaw Center 

HAWAII 

Central Intermediate School 
Diamond Head School for the Deaf 
McKinley High School 

IDAHO 

Idalio School for the Deaf and Blind 

ILLINOIS 

Bell Llenienlary School 

Bi County Oral Deaf Program 

Black Hawk Hearing Handicapped Program 

Champaign Community Schools 

Chicago Vocational High School 

Decatur Public School District 

Blim Christian School for the Lxceptional Child 

Kricson School 

Illinois School for the Deaf 

Jamieson School 

Marquette Elementary School 

Thomas Metcalf School 

Morrill tlemenlary School 

Northern Suburban Special Education District 

Northwest Suburban Special Education 

Organization 
Northwestern Illinois Association V 
Perry School 



Ray School 

Reinberg School 

Scammon School 

Shields Elementary School 

South Metropolitan Association for Low-incidence 

Handicapped 
Special Education District of Lake County 
Springfield Public Schools 
West Suburban Association lor the Hearing 

Handicapped 
James Ward Elementary School 

INDIANA 

Glenwood Elementary School 
Hammond Public Schools 
Indiana School for the Deaf 
Marion Conmiunity Schools 
Morrison«Mock School 
Fayette County Schools Corporation 

IOWA 

Black Hawk-Buchanan County Board of Education 

Cedar Rapids Community Schools 

Hope Haven School 

Iowa School lor the Deaf 

Wilson School-Oral Deaf Department 

KANSAS 

Kansas School for the Deaf 
Wichita Public Schools 

KENTUCKY 

Kentucky School for the Deaf 
Louisville Public Schools 

LOUISIANA 

Acadia Parish School Board 
Lafayette Parish School Board 
Louisiana School for the Deaf 
Monroe City Schools 
Sunset Acres School 

MAINE 

Governor Baxter State School for the Deaf 

MARYLAND 

Baltimore County Department of Special 

Education 
Maryland School for the Deaf 
Montgomery County Public Schools 
Prince George*s County Public Schools 



MASSACHUSETTS 

Iklnionl Public Schools 

Ikverly School for the Deaf 

Boston School (or the Deaf 

Peter Bulkclcy School 

Clarke School for ihe Deaf 

Lawrence PrirTiary Program for the Deaf 

Leonnnsur Day Classes for the Hearing linpaired 

Horace Mann School for the Deaf 

Mercer School 

Willie Ross School for the Deaf 

Upsala Slieet School 

Woburn Day Class Program 

Worcester County Hearing and Speech Center 

MICHIGAN 

Howard D. Cruli Jnlermediate School (Roosevelt 

Elementary) 
Detroit Day School for Deaf 
Douglas School 
Durant-Tuuri-Molt School 
Escanaba Area Jr. High School 
Fernda!e Public Schools 
Handley School 
Jda Public Schools 
Katarna/oo Public Schools 
Ana J, Kellogg School 
Lakeview Elenicniary School 
Lakevjew Public Schools 
Lindemann Elenicniary School 
Lutheran School for the Deaf 
^ Marquette ElenKntary 
Michigan School l^or the Dejf 
Oakland Schools 

Public School Program for Deaf and Hard-of- 

Hearing, Jackson 
Traverse City Public Schools 
Utica Schools 

MINNESOTA 

Duluih Public Schools 

Minnesota School for the Deaf 

St. Paul Area Program for Jfiipaired Hearing 

MISSISSIPPI 

Mississippi School for the Deaf 
Popp's Ferry Elementary School 

MISSOURI 

Central lnsfitute for the Deaf 
Delaware Elemenlajy School 
Lilzsinger School 



' Missouri School for the Deaf 
S\, Louis County Special School District for the 

Handicapped 
School District of Kansas City 

MONTANA 

Montana Stale School for the Deaf and Blind 

NEBRASKA 

Nebraska School for the Deaf 

Omaha Public Schools 

Prescott Acoustically Handicapped Unit 

NEVADA 

Ruby S. Thomas Elemenlaiy School 

NEW HAMPSHIRE 

Ciotched Mountain School for the Deaf 

NEW JERSEY 

Bruce Street School 
Class for tfic Hard of Hearing, Kearny 
Cumberland County Public Schools 
Hdckensack Program for the Deaf 
Marie H. Kalzenbach School for the Deaf 
Millburn Avenue School 
Township Public Schools, Neptune 
Woodbridgc Public School Systen^ 

NEW MEXICO 

Nev/ Mexico School for the Deaf 

NEW YORK 

Board of Cooperative Educational Services, 
Nassau 

Board of Cooperative Educational Services of 
' Washington, Warren and Hamilton Counties 
Board of Cooperative Educational Services^ Suffolk 
County II 

Board of Cooperative Educational Services, Suffolk 
County HI 

Catholic Charities Day Classes for Deaf Children 

Mill Neck Manor Lutheran School 

New York School for the Deaf - White Plains 

New York State School for the Deaf - Rome 

Rochester School for the Deaf 

St. Erancis De Sales School fox the Deaf 

St. Joseph's School for the Deaf 

St. Mary's School for the Deaf 

School for Language and Hearing Impaired 

Children Public School 1 58 
Union-Endicoll Central School Distfici 

59 



NORTH CAROLINA 

taslofii Nofih (\ifi>lnij Schoi)i tor iho DcjI 
North Carolifij Scfiuol lor (he Deal 

NORTH DAKOTA 

Lunglellow Scfiool 

Nuiih Dakota Scliuol lor [\w Deal 

OHIO 

Alexander Grjhuni Bell School for the Deaf, 

Clevehind 
Ca/iion Public Schools 
Kennedy School lor the IX^f 
Kent Public Schools 
Lakewood Public Schools 
Lorain Board of I: duration 
Mansf ield Ciiy Schools 
Ohio School for the Deaf 
Program lor Physically Mandicapj^>ed. Toledo 
Springfield Cily Schools 
Youngslown Public Schools 
Zanesville Classes for IX^a! 

OKLAHOMA 

Kerr Junior High School 
Oklahoma Cily Public Schools 
Oklahoma School Tor the Deaf 
University of Oklahoma Medical Center 

OREGON 

Oregon State School for the Deaf 
Portland Public Schools 
Tucker»Ma\on Oral School 
Washington County Intermediate Hducation 
District 

PENNSYLVANIA 

DePaul Insiilute 

Ebensburg State Schooi and Hospital 
Erie City School District 
Home of the Merciful Saviour for Crippled 
Children 

Willis and Hli/abeth Martin School 
Pennsylvania School for the Deaf 
Pennsylvania Sla(e Oral School for llie Deaf 
Programs for Sf>cech and Hearing Handicapped- 
Centre County Schools 
Clinton County Schools 
Fayette County Schools 
Norihamplon County Schools 
Western Pennsylvania School for the Deaf 



RHODE ISLAND 

Rhode Island School for the Deaf 

SOUTH CAROLINA 

Florence County School District ^3 

Pate Flemenlary School 

South Carolina School lor the Deaf and Blind 

SOUTH DAKOTA 

South'Dakota School for the Deaf 

TENNESSEE 

Knox County Public Schools 

Mcmphij Parents' School for Deuf and Aphasic 

Tennessee School for the Deaf 

TEXAS 

Abilene Public Schools - Day Class for the Deaf 

Austin Independent School District 

Bexar County School for the Deaf 

P.F. Brown Hlenientar) School 

The Callier Hearing and Speech Center 

Corpus Christi independent School District 

County-Wide Area Day School, Fl Paso 

Dallas Independent School District 

Hereford Independent School District 

Houston Independent School District 

Houston School for Deaf Children 

Tarrant County Day School for Deaf 

Texas School for the Deaf 

Wichita Falls independent School J^istricl 

UTAH 

Utah Schools for the Deaf and Blind 
Utah Slate University - Edith Bowen Laboratory 
School 

* 

VERMONT 

Austlne School for (he Deaf 

VIRGINIA 

Arlington County Public Schools 
Charlottesville Public Schools 
Diagnostic, Adjustive and Corrective Center for 
Learning 

Virginia School for the Deaf and Blifid 
Virginia State School for the Deaf at Hampton 

WASHINGTON 

Bellevue Public Schools 
Bellingham School District #501 
Edna E. Davis School 



Nonhshore School District #4 1 7 
Seattle Public Schools 
Shoreline School District #412 
Washington Slate School for the Deaf 

WEST VIRGINIA 

West Virginia School ibr the Deafand the Blind 

WISCONSIN 

City District Public Schools, La Crosse 
Day School lor the Deaf, Wausau 



Lincoln Llenicntary, Fau Claire 
Madison Public Schools 
Pleasant Hill School 
St. John s School for the Deaf 
School for the Deaf, Green Bay 
School for (he Deaf, Oshkosh 
t. \l Wadewit/ School 
Wisconsin School for the Deaf 

WYOMING 

Wyoming School for the Deaf 



nEPORTS FROM THE ANNUAL SURVEY OF 
HEARING IMPAIRED CHILDREN AND YOUTH 



No. 1 AcadfMTuo Achievon>ent Tost Pertorfnafuo of Hoanrxj IrtipairtHl Sludents 
Unitod States Sprifig 1969 

No 2 Item Anaiysis of Acadofnic AchievvMnont iosts florinng Ifnipaifod Studonls 

Ufuted Slates Spring t9G9 

No 3 Addirjorial Handicappiricj Conditions. Aye at Qnsel of Fiearmg Loss, and Other 
Cf'araclerfstics of Mearinci hTipauod Students United States; ^968-69 

No 4 Type and Siee of Educationai Progranvs Attended By Hearing hnpaired Students 
United States: 1968-69 

No b Summary of Seloctod Charactensncs of Hearing Impaired Students ■ - United 
States 1969 70 

No b Audioioqicaf [Examination'^ of Hearing Impaired Students United Slates: 1969- 
70 

No 7 Characteristics of Hearing Impaired Students Under Six Years of Age United 
States: 1969-70 

No, 8 Item Analysis of an Achievement Testing F^rogram for Hearing Impaired Students 
- United States Spring t97? 

No 9 Academic Achievement Test Results of a National Testing Program for Hearing 
ImpairecJ Stucionts United States: Spring 1971 

No 10 Ct^a^ar torisucs of Vieanng Impaired Students by Hoanng Status - - United States: 
■ 1970^71 

No 1 1 Studies m Achievement Testing Hearing Impaired Students — United States: 
Sprang 1971 

No ^2 F^eported Causes of hQaruM) Lost for Hearmg Impaired Students — United 
States: 1970-71 

No 13 Further Studtos in Achievement Testing, Hearing impafred Students — United 
States Sprmg 1 971 



SPECIAL REPORTS FROM THE OFFICE 
OF DEMOGRAPHIC STUDIES, GALLAUDET COLLEGE 

No, V NatKonai Survey of State Identification Audiometry Programs and Special Educa- 
tional Services for Hearwvj fmpaued Children and Youth — United Slates: 1972 



